i think there are still tons of candidates who go to interviews but dont know how to code.(http://www.codinghorror.com/blog/2007/02/why-cant-programmer...)
As a fresh CS graduate, I feel like many of my classmates couldn't actually code, this would definitely help the companies to screen out people.
Math is crucial for your startup and I hear that, but not all of the companies need intensive math.
I do agree that those questions wouldn't sufficiently test real-world problem solving skills. But i guess companies could still do interviews after people passed the questions on the website.
"i think there are still tons of candidates who go to interviews but dont know how to code. ... As a fresh CS graduate, I feel like many of my classmates couldn't actually code, this would definitely help the companies to screen out people."
Gads. Some parts of coding are easy. Some parts, say, understanding and having good experience with 3000 Web pages of .NET documentation at MSDN, can be more challenging! But even .NET is not difficult conceptually except in the many cases where the documentation sucks and the reader has to guess at what is going on to see how to use .NET.
So, in simple terms, coding is easy. More generally, everything it takes to code a significant application now is challenging in several respects; even if all the respects are just routine, they can be a LOT of work.
"Math is crucial for your startup and I hear that, but not all of the companies need intensive math."
That's right: But the third test question is really about math, just math, instead of computing. So, as I said, the third question is an example of computing being out'a gas and looking at applied math for content. The third question has some cute applied math content but, in nearly all of current computing, not much relevance to getting a significant application running. My work, using math, is an exception: Still, I'm not tempted to do some applied math to get a solution to 'prove something' to Interview Street. So, point: The emphasis on math by Interview Street is not good, not even for me who likes math. Indeed, as I explained, likely the people at Interview Street are in over their heads and would not understand the math of a good solution to the third problem even if I programmed it and documented it.
"I do agree that those questions wouldn't sufficiently test real-world problem solving skills. But i guess companies could still do interviews after people passed the questions on the website."
The questions are worse than that: In my business, I'm into a lot of math, but even I don't like the questions for selecting people. For businesses not so into math, the questions are still worse.
Net, the questions are just to 'select out' some people for no good reason. Indeed, there is good reason good people will refuse to answer the questions! So, the questions are dysfunctional and destructive.
In slightly more advanced terms, common in testing in the social sciences, the questions have no 'validity', that is, don't accurately measure what we want measured!
'Validity' is a big, HUGE deal: E.g., the SAT and CEEB tests are supposed to be 'valid' measures of ability to do well at college work. The GRE tests are supposed to be the same for graduate work. Etc. for GMAT, LSAT, etc. Establishing 'validity' for these tests was NOT easy. Generally establishing validity is not easy.
More likely 'valid' is what several posts in this thread have mentioned: Show me the working significant, practical, valuable application!
Once get validity handled, then we have to move on to 'reliability' which is essentially the 'variance' or 'accuracy' of the 'estimator' being considered. Or, in terms of mathematical statistics, the 'test' is an estimator of something we want to know, and 'validity' is the statistical 'bias' of the estimator and 'reliability' is it's variance (or the square root of the variance, that is, the standard deviation, if we prefer).
Here is the ugly side of Interview Street:
(1) The programming of their Web site sucks. We wouldn't want to hire the people who developed that Web site.
(2) The writing and the math in the presentation of the questions sucks. We don't want people evaluated in such content by people who have shown such low quality work with such content.
(3) The questions are heavily from just applied math (done poorly) with next to no 'face validity' at anything important for the intended purpose of recruiting 'rock star' hackers or whatever was the coveted goal.
(4) In the applied math, especially in the third question, they are likely in over their head and would not understand a good solution if they saw it.
Interview Street needs to clean up their act: Clean up their Web site, clean up their problem statements, make the questions relevant to the stated recruiting goals, and pay at least some attention to at least 'face validity' of the questions.
Really, these questions are the same song, second verse, of some Google HR nonsense as in
For the companies recruiting, recruiting challenges are well known: The 'HR' people want to be central in recruiting, and there my analogy of the absurdity of having house painters looking for Michelangelo to paint the ceiling in on target.
As a broad rule, under no circumstances should anyone in HR ever, on threat of immediate dismissal, mention anything technical to an employment candidate! Instead, HR people can smile, be nice, talk about the weather, offer coffee, tea, and soft drinks, help with travel and lodging reservations, help make reimbursement or cash advances easy, help with names and titles of people the candidate meets, explain the interview schedule, offer names and titles of people in HR for continuing contacts, be sure the candidate has enough rest time and a nice lunch, try to get the candidate a meeting with someone the candidate might know, pass out a benefits packet, indicate where the rest room is, smile, be nice, offer some fancy snacks, smile, be nice. Did I mention smile and be nice?
Math is crucial for your startup and I hear that, but not all of the companies need intensive math.
I do agree that those questions wouldn't sufficiently test real-world problem solving skills. But i guess companies could still do interviews after people passed the questions on the website.