Wednesday 15 October 2008

Peer Review Smells.

Most academics who have thought about it will agree that peer review is just rubbish. It is ridiculously hard work - work volunteered by academics as a mulct on their lives. And it is subject to the politics of the playground. Most subjects and academic communities are simply too small to allow true anonymity, and as a result the outcome of peer review is frequently informed by nothing more than hubris and hurt feelings.

My personal bugbears regarding peer review are that, first, it is inherently conservative - encouraging a narrow definition of scholarship; and second, that it forms a comprehensive subsidy on publishers that in turn shifts money that should be spent on either research or dissemination into the coffers of private companies. Universities pay for the privilege of buying journals that are written and edited by their own staff, and reviewed at their own expense. In an online environment, where the costs of printing is decentralised, this makes no sense whatsoever.

At the same time, there are aspects of peer review I like. I want to know that someone with some expertise thought an article was worth publishing. It saves me the time (the seconds it takes to skim a few hundred words) otherwise spent on determining whether the material being discussed is worth the effort of reading.

The traditional answer to these complaints and observations is the care-worn observation that peer review is the worst system ever, except for all the others.

But, with the advent of new models of online sharing and community interaction, it seems to me the moment to reinvent this particularly irritating wheel. Why not create an open 'academic journal space' for all articles that anyone cares to post, with a tagging regime for subject definition. In other words, anyone could post under the tags 'eighteenth-century British history', or indeed 'past & present'. If editors, or foundations, chose to shepherd particular collections of tags and to create an 'identity' from this association, this could certainly be accommodated. Moves in this direction were commonplace in many science subjects in the 1990s, but it hasn't resulted in a reform of the world of journal publication.

The point, however, would be to ask all contributors (all people - even academics - who choose to post a contribution) to also undertake a series of peer review assessments. These would be post-publication, but since online material could be continuously edited, it would nevertheless act in the way current pre-publication peer review acts in relation to polishing an article.

The point, however, would be to rate the assessors. I am more interested in what Natalie Zemon Davis thinks about an article on 16th century France, than I am in the opinion of a third year undergraduate (at least in the first instance). By allowing assessors to themselves build up an online profile you could incorporate a continuum of quality that is made up of the opinions of all assessors, weighted according to authority (i.e. the opinion of three senior figures in a field, could balance out that of 12 graduate students, or 18 unrated individuals, or whatever). The rating of individual assessors, could be determined by what they have contributed in the past, or based in a metrics of cross posting of the sort being used by the Australian and UK higher education systems to distribute research income. There are real problems with metrics, but they do form a consistent measure of community regard (at least in most subjects).

The result would be an academic commons that nevertheless preserves the 'authority' that is the single valuable aspect of peer review. It would also open up academic publishing to a broader community. There is no reason for 'outsiders' not to post material. Much of it might be denigrated by 'high authority' reviewers, making it possible to still select out articles of a certain 'standard', but it would also create a way in of a sort that doesn't frequently exist in the current system. Groups of reviewers who choose to generate a 'journal' identity, could still do so - with the 'journal' being made up of those articles that a defined group of 'assessors' chose to assessn positively.

As an evolving community of assessment and contribution, the system would be self-validating, and a lot cheaper to run than the plethora of journals currently clogging our libraries and lives.

34 comments:

Unknown said...

This is a hanging and significant point in there. you're pivotal, I really like your submit and i am sitting tight to your subsequent put up.

Essay Help | Essay Writing Service .

waylanmarx said...

Instant payday loans are really quick loans online, which gives them a chance to be more preferable in payday loans comparison with other loan options offered by the traditional lenders.

avalee said...

We consists of highly experienced and professional ghostwriter UK who can emulate the writing style of any student. The ghost writers work hard to help students achieve A+ grades. They also maintain all the university guidelines and craft the paper accordingly. We hires writers who have attained their Masters and PhD degrees in Science. They provide impeccable and scoring Science Assignment Help to the students who need assistance. Students can also contact them in case of tight deadlines, because they have premium writers who can deliver the work within 24 hours.

Michael Jones said...

In such situations, taking assignment help online from experts ends up to be very helpful. The experts provide you with professionally written assignments which are individually crafted to cater your needs and meet your expectations. Assignment Help

Michael Jones said...

you can go throughAllAssignmentHelp reviews. It will help you to know about the services, and it will help you to know whether that site is reliable or not. This is a way of understanding the opinion of users, and it helps the website to maintain its functionality and reliability.

Uae Assignment Help said...

Our academic writers have high degrees like masters Ph.D. from a top university. Our expert writers provide plagiarism free assignment and assignment delivered on time. You can take any essay writing help so just send an email us at info@uaeassignmenthelp.com

singapore assignment help said...

By getting the Myassignment help written by Singapore Assignment, University students can get the best and reliable assignment work available at affordable price.

Adam Thomas said...

Very attractive information blog post, my favorite article post thank you very much for these amazing content. AllAssignmenthelp.com Reviews

Stefan Carl said...

If you want help in your essay writing then hire our essay writers on essay writers UAE and get the finest essay help with 100% unique content and it is absolutely free from plagiarism. We provide 100% guaranteed privacy of your data.

AB Assignment Help said...

Hey, your post ii very informative to me. Thank you. If you want to write the best assignment but due to lack of time this can be delayed and you can lose your grades. Our Experts are excellent for online assignment help services on AbAssignmentHelp in the Uk. You have needed help, then we are on 24/7 support.

Lara Gargett said...

You have come at the right place! Why not relax, while our professional hands do it at affordable rates? With a diverse range of services like Nursing Assignment Help, Finance Assignment Help, Law Assignment Help, Online Assignment Help, report writing, and many more in a plethora of subjects, working round the clock with dedication and striving to deliver 100% satisfaction to clients.

MyAssignmentHelp said...

Thank you for sharing this informative post.MyAssignmenthelp.co.uk is giving assignment help to students.we are already trusted by thousands of students who struggle to write their academic papers and also by those students who simply want Online hr assignment Writers to save their time and make life easy.

Anonymous said...

Using a properly created model of an outline is very helpful in producing the one for your informative essay. By looking at informative essay outline example, it will be easier for you to compose a great piece of writing.

Bill Caster said...

It is very common for students nowadays to copy writings of one person and put it in their assignment or essay paper whichever they are writing.How to Reference a Blog in Harvard Style.

Ideal Assignment Help said...

Thanks for sharing this kind of information We have been the best in the business of providing top quality Assignment Help writing services. We are available 24*7. Programming assignment help enables students and understand the aspects of various languages. Contact our expert team.

ireland assignment help said...

Thanks a lot for sharing this post. If you need care of the older person assignment sample services then hire our experts writers. You can check our website also:- irelandassignmenthelp.com

chloebailey said...

It look not like a Business Report Format Writing but it's also well-written. I like writing and reading something like this. As well, it can be more detailed. What do you think?

rose said...

Assignment Help is an association where understudies can get logically stunning plans in which we can get prompt contact with the masters who can form the undertaking according to the customer with full core interest.
mathematics assignment help
Assignment Help UK

Ciana Langham said...

Hello! I decided to share with you some useful information about writing papers. Here is one cool writing service that can help you if you need some writing help with the nursing school interview questions

Anonymous said...

If you don't know how to write a white paper, read the white paper example and it will help you to understand how to deal with this essay better and faster.

Iqbal Mohammad said...

deneme bonusu

Hoşgeldiniz için güvenilir bahis sitesi, Web âleminde birçok kullanıcı güvenilir bahis sitelerine kayıt olup para kazanmak istiyor fakat o kadar çok güvenilir bahis sitesi var ki teklif deneme bonusu. Deneme bonusu ve Bedava bahis veren bahis siteleri hakkında bilgi edinebilir.

to get more - https://bigwins.today/

Law Assignment said...

Nice Post
Employment Law assignment help
Online Employment Law assignment help
Employment Law help
Employment Law expert
Employment Law coursework
Employment Law dissertation
Employment Law Australia

Grace Ella said...

Thanks for giving us accurate information by writing reviews. I always give preference to reading the reviews when it comes to knowing the truth of anything. Getting good grades is possible by selecting a Dissertation Writing Services

Caleb said...

Hey Nice article here. What CIPS assignment are you tackling now? Do you need CIPS assignment help? Frankly, most CIPS topics aren’t exactly rocket science. You’re either writing about cost reduction, setting KPIs, demand management, or conflict resolution. Maybe it’s a business process re-engineering (BPR) assignment. Read more on CIPS Homework Writing Help

Jenifer said...

Australian assignment Writings named experts who have extraordinary information about the composition from The University and schools of UNSW Sydney, Sydney, University of Technology Sydney, Macquarie University, and some more. We will allocate your undertaking to the author who can finish your venture and program with amazing outcomes. They realize very well what a brilliant paper implies for your guides. They can carry it to you. more- programming assignment help , assignment help

My Assignment Help Online said...

This article has it all thanks for sharing. The help to write any type of document requires numerous things to consider and a lot of time too. myassignmenthelp

Unknown said...

Agreed with you. Giving a peer review is not easy, you have to consider many things at a time. affordable professional logo design services online

Shira said...

We Global Assignment Expert believe that your satisfaction is the key to our success. Mostly for the Australian’s student, we are trying to enhance our online website in order to ensure better 24x7 online supports as per your requirements. Academic period of any student is one of the vital junctions of a career. Assignment Help Services provide good quality academic writing services that will help you to gain a good grade in your assignment lesson.

Alanusa said...

Your blog has expanded blog article. World No 1 Assignment

Dissertation Help said...


Thank you for such a supportive thought on your site which help me in gaining informative knowledge.
We also provide service in Sop(Statement Of Purpose)writing services which is required for taking admission in college/university into another country.Student searach for best sop written services by any professional writer but many of them not able to find such a writer who write clear and outstanding sop. TheStudentHelpline provide such a writer who write best and perfect sop for student visa for you while keeping you expectation into the mind and deliver you sop on time.

Anonymous said...

Most of the times, kids are often interested in playing with the toys. you can buy several kind of toys from amazon but you can't get unique variety toys from the amazon. It is because kids motorbikes are one of the ride on Vehicles which are more liked by the children, but, you rarely found very few models on world's largest e-commerce. However, you can buy kids motorbike from the store which offer very unique and different range of the models to the consumers. They have scooties, sports bikes and also electric motor vehicles with more than 50+ variety of bikes to choose from. Even the price is also very affordable as you can get the ride on bike starting from $49 and highest range being around $129.

If you were looking for a good quality kids ride on motorbike, then you need to buy from the trusted and certified retailer. These retailers direectly source the products from the chinese manufacturers on the "alibaba which is famous for most of the toy imports to the UK. they partner with one of the most trusted manufacturers who are being in the Industry since so many years and have En71 certified quality materials will be used while manufacturing the products. They also provide 1 year warranty for the products and also have best customer support after the sales.

Hence getting the kids motorbikes from such kind of retailers will help to ensure that your child won't get disappointed. Especially, children will easily break anything these days but if you want a product which lasts longer than need to buy from the certified retailers who offer the warranty. The site also offers free delivery to the customers all across the United Kingdom making the ride on vehicles to be most affordable for the parents to gift to their children. Thus if you were looking to buy the ride on children's motorbike then have a look at the store.

--

Joseanthony said...

Students are frequently perplexed about their productivity in assignments. We are always looking for something better, more organized, and more productive. When we approach any type of Assignment helper, we must ensure that the output is unique and realistic. The various professions and people involved in their studies appear to be very in sync with the two. In today's world, such a situation is unavoidable. It tells you what to do and how much to do in a given time frame. It also allows us to pursue our interests or become wealthy through a productive purpose or process. We can help you with your assignment writing and help you get good grades. Our expert team of professionals and academicians will assist you in achieving high grades and producing well-organized work. Our online assignment help includes both professional and personal attention. We take your preferences and assignment details into account, and together we create the best.

Essien said...

I'm glad to be one the beneficially of this article. It’s useful, really interesting to everyone and I appreciate you spending some time and effort. Thank you so much for sharing! shl past question in pdf format

Digital marketing company in Dubai said...

It's a well structured article and written in an impressive way. You have done a great job. Keep on writing and sharing.
Web designing companies in Dubai