Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Here's a nice example of the "contingency" of scientific success by Bol, de Vaan, and van de Rijt (2018). https://www.pnas.org/doi/10.1073/pnas.1719557115

Grants are reviewed and ranked by a panel of experts. While they often agree in the broad strokes, their scores also have random or subjective components: different reviewers might prefer different approaches; even the same reviewer might give slightly different scores if they re-reviewed a grant (e.g., due to their mood). However, someone eventually does need to set a payline, or threshold for funding.

As a result, you'd expect people who submitted the worst funded grants and the best unfunded grants, which have very similar scores, to have similar career trajectories. After all, their abilities--as measured by grant scores--are virtually indistinguishable. However, the winners go on to win nearly twice as much funding in the next eight years. This presumably reflects the fact that funding begets more funding (you can collect more and better data for subsequent work) and prestige begets more prestige (you've now got another thing to put in the "awards" category).



This gets even murkier when you consider that grant award and citation statistics are correlated only like 0.3 or something.

It's the Matthew effect multiplied by Goodhart's law.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: