I have to stop reviewing other people’s stuff.
Raining criticism on people really bums me out. I am in the middle of a panel (yes, again) and just feeling desperate. (It doesn’t help that I am a double token: token woman and token theorist on an experimental panel). Of the batch of the proposals I reviewed, most were really very good: well written, engaging, feasible. But, during discussion, you find that one person’s feasible is another person’s incremental. One person’s exciting and transformative and worth taking a chance on is another person’s unconvincing and needing a third mountain of preliminary data. Ripping apart good proposals so we could justify funding only 15% is a freakin’ slaughter of science. NSF funds good science; it also doesn’t fund probably 3x as much science that’s just as good.
One panelist didn’t give anyone more than a G (E-excellent; V- very good; G – good; F – fair; P – poor) and gave several people a P. G already completely eliminates a proposal from the running. Nobody should get a P, that’s just downright mean; P basically coveys that the reviewer thought you were a total moron. There were several proposals that started with scores like E/V, V, G, P. Seriously, the same proposal is both excellent and poor?
The worst thing about NSF peer review in particular is that the reviewers raise all these issues that may or may not hold water, and you have no opportunity to defend yourself. Even if the reviewer is very wrong, unless someone who understands that is on the panel, was assigned your proposal, and is also not a know-it-all a$$hole, the unfounded criticism stands and sinks a good proposal.
I want to read papers and enjoy them and admire people’s cool ideas. I am tired of hunting for things not said, or tangents not addressed; I am tired of hearing of the minor flaws others hunted down and blew up into fatal weaknesses. I want to believe that most people are serious scientists, and if they have ideas for which they painstakingly collected preliminary data and wrote a proposal on, that they are usually serious, willing, and able to to do the work.
It also makes me desperate in the face of writing more proposals of my own. Somehow, whatever I write, however I write it, it’s just not quite there. People say my proposals are good and that I just have to keep resubmitting, that the successful people wait it out, but what’s the point? If you don’t get funded the first 2-3 times, the field moves on. Formerly competitive proposals get stale.
I’m gonna get some beer at the hotel restaurant, bring it to my room, and work on panel summaries.