There is one other drawback to the arXiv that makes me, as a potential submitter, very nervous: being scooped.
A paper is “scooped” if someone else publishes the same (or very similar) concept before you get a chance to publish yours. But, wait, if it is on the arXiv, isn’t that documentation that I had the idea first? Well, yes, but… the arXiv isn’t commonly used in Biology yet, so it isn’t clear how important or how much priority will be given to authors who publish there before “traditional” peer review. This is especially concerning if the novelty of the paper is the idea (which is easy to reproduce with the same or different data) versus a method (which is more difficult to replicate). Maybe this isn’t a valid concern, because anonymous reviewers could, one might argue, just as easily “scoop” ideas from a manuscript they have reviewed. Furthermore, perhaps posting ideas/research early might facilitate more collaborations instead of competitions between research groups.
All said, I think that submitting to pre-print servers can be a very valuable tool for facilitating scientific discourse and advances. Will I start submitting there? We will have to wait and see.
It doesn’t matter to me at this point that people might have qualms. Once sufficient consciousness is raised and critical mass is achieved, then you’ll see a stampede. Some fields in biology may be late into the shift toward preprint distribution, but for the purposes of a lot of the stuff I cover on this weblog I doubt that will matter. When it comes to evolutionary biology that isn’t being funded by pharma or private foundations I don’t think there’s much holding people back aside from the worry about being scooped.
I don’t know much about academia and its intrigues personally, but I have heard of instances of reviewers squatting on a paper until someone else associated with the reviewer publishes (yes, people know who is reviewing in many cases, or suspects). This is a form of scooping, but it occurs in the shadows, and there’s always deniability. Who knows how we can quantify this sort of behavior? But it’s something to that we need to keep in mind when we’re worried about the pitfalls of open access and preprint distribution.