I always have problems with tests like this, and I imagine they work poorly for highly-analytical people. Take this question: "Looking out for myself is my top priority."
I know if I put "strongly agree," it'll be more likely to call me a psychopath. At the same time, I'm thinking, "I look out for people I love - sometimes at risk to myself - but ultimately that's only because they matter to ME. Looking out for others is undeniably motivated by what matters to me."
Aside from the false dichotomies, surely any psychopath with even a shred of intelligence could answer strategically and defeat the test's intended purpose. And they use this in prison hearings?
A few years back I was tangentially involved in a very clever study involving the executive ethics that was designed to address this concern.
Some of the questions were routine business questions, others were general questions about the material they read, and, the meat of the questions were ones on the moral consequences of executive decisions. It was expected that executives would answer all the questions correctly. Instead, the study scored based on how long it took them to answer the moral questions as opposed to the general questions. These scores were then compared against respondents from a control group of non-executives.
EDIT:
Gosh! I hope I'm representing her study accurately... "Business Experience and Moral Awareness: When Less May be More", Jennifer Jordan (2005)
OP here, totally agree with this. That question is almost "How honest are you with yourself?"
Takes a bit of scrolling down the page of results[1], but people are actually pretty honest on that one, the mode response is "Agree somewhat" (this finding is from our initial, seed sample).
Also agree about the ease of getting around this. Particularly if you're a psychopath, and are therefore good at being manipulative. The version of this test used in parole settings[2] deals with this by having professional interviewers who use the person's history and records to make assessments, in addition to the interview. (Note that I'm not actually defending that process; part of the point of this and NPR's recent discussions about psychopathy is to stimulate thinking about whether stuff like this should actually be used for important decisions like parole)
> Aside from the false dichotomies, surely any psychopath with even a shred of intelligence could answer strategically and defeat the test's intended purpose. And they use this in prison hearings?
Psychology is a science, just like pizza is a vegetable.
The thing is, the way you deal with those questions is part of the test. You say that you look out for other people because they matter to you. But just by saying that, you give away a very important piece of information: other people matter to you. They matter enough that sometimes you'll even take risks for them. That's a reasonably strong indicator of non-psychopathy in and of itself.
I would argue that the intent of the question is asking what matters to you, and on that basis I picked "disagree somewhat".
Of course I'm still just not-executing-my-nonexistent-utility-function, but the point is that said utility function cares about people other than myself. In aggregate, more so than myself.
I've had this exact same thought before. I love manipulating people's feelings in certain ways. I like making people have fun. If you're in a bad mood and someone goes out of their way to try and put you in a good mood they have intentionally manipulated you.
I know if I put "strongly agree," it'll be more likely to call me a psychopath. At the same time, I'm thinking, "I look out for people I love - sometimes at risk to myself - but ultimately that's only because they matter to ME. Looking out for others is undeniably motivated by what matters to me."
Aside from the false dichotomies, surely any psychopath with even a shred of intelligence could answer strategically and defeat the test's intended purpose. And they use this in prison hearings?