Faculty of 1000

Post-publication peer review

Somewhere over the rainbow

Posted by rpg on 27 July, 2009

Somewhere in the depths of PLoS One an article lurks…

Liz Allen and her friends at the Wellcome performed an interesting study on papers that came out of labs that were at least partially funded by Wellcome grants. What they did was to figure where each of the nearly 700 papers ended up being published, and then looked at bibliometric indictors (cough impact factors cough).

Nothing new there, really. The clever bit was to persuade a ‘college’ of experts (I hate that word, sorry) to review the papers, and then compare this with the bibliometric indicators… and with the Faculty of 1000. Funnily enough, highly-rated papers did not necessarily get cited highly (so the Impact Factor doesn’t help here), but the F1000 ratings agreed pretty well with their college of experts, and was also able to predict citation rates to some extent.

We were pretty stoked about this paper, I can tell you: and we hope to have a chat with Liz next month and show her some interesting stuff we’ve been up to. It plugs directly into this:

Tools that link expert peer reviews of research paper quality and importance to more quantitative indicators, such as citation analysis would be valuable additions to the field of research assessment and evaluation.

I’ll write more about that nearer the time. Or even, given the bonkers-mad workflow I’ve got going on, after the time. Until then, you can check out the more in-depth analysis and a fascinating discussion over at my personal blog.


6 Responses to “Somewhere over the rainbow”

  1. Just thought I’d stop by and see your latest blogging extravaganza. Now back to my own “bonkers mad workflow”.

  2. rpg said

    Nice to see you Richard!

  3. cromercrox said

    Excuse me, did you see Stephen Fry pass this way? He was trying to catch a bus to the station.

  4. Hello Richard,

    Good luck with the new blog!

    Maybe it’s just me, but I always find white on black very difficult to read and it has strange effects. Not as bad as the flashing figures in Cell Press/Elsevier’s Article of the Future protoypes – could only take a few seconds of that – but very distracting. Might put some people off visiting or lingering?


    • rpg said

      Hello Irene!

      Thanks for dropping by. Thanks for your comments: I might well have a poke around with the design (basically, we needed something up asap and I haven’t had much time to play with it).

      Will look for something nicer, maybe. Currently our web designer is busy working on our launch so no time for this sort of frivolity …

Sorry, the comment form is closed at this time.

%d bloggers like this: