waider: (Default)
waider ([personal profile] waider) wrote2005-01-20 11:48 pm

a scientician writes...

I've been reading this paper that [livejournal.com profile] tongodeon referred to recently: "Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments". Grossly paraphrasing, the authors are attempting to prove that the dumber you are, the less likely you are to realise that you're dumb. The paper's interesting, even if the statistical notation is beyond me, but I do like the style. In addition to the whole bit about asking comedians to rate jokes in order to establish a baseline, there's this:
Participants. Four to six weeks after Phase 1 of Study 3 was completed, we invited participants from the bottom- ( n = 17) and top-quartile ( n = 19) back to the laboratory in exchange for extra credit or $5. (my emphasis)
I like that. I don't know if it's par for the course when you're explaining how you motivated people into participating in your study, but it certainly amuses me to see it put that bluntly.

Oh, and for what it's worth, I've actually learned something useful out of this aside from the main theme of the paper: the "false-consensus effect". This is where you underestimate something like your percentile rating on a test because you're assuming that your peers were at least able to get the same things right that you did. This has interesting implications in, for example, my line of work where I'm unconciously drawing on more than ten years of messing about with Unix systems; things that seem obvious to me, and which I assume others have already accounted for, may not in fact have been addressed at all. Mind you, I was already kinda taking that approach anyway.

[identity profile] rimrunner.livejournal.com 2005-01-20 11:52 pm (UTC)(link)
I don't know if it's par for the course either, but it's not infrequent that I see it.

Also, I don't know if this is better or worse, but people of all intelligence levels tend to think that they're better at finding information than they really are. If memory serves; it's been awhile since I read the study.

[identity profile] yong-mi.livejournal.com 2005-01-21 12:04 am (UTC)(link)
Papers reporting on experimental results involving human subjects have to report whether subjects were paid or compensated in some other fashion.
From the conference paper my advisor and I are currently working on:
"All participants were volunteers, and were offered monetary compensation for their participation."
Economics papers are more likely to list the specific amount of money participants were given. Fields such as psychology usually will just mention if people were paid or were required to participate as a course requirement.

[identity profile] bitpuddle.livejournal.com 2005-01-21 12:46 am (UTC)(link)
I'm in the middle of this right now! Review season at work, and some people have wildly inflated senses of their own abilities. Frightening.