Stories
Slash Boxes
Comments

SoylentNews is people

posted by n1 on Tuesday June 02 2015, @09:39AM   Printer-friendly
from the lies-and-statistics dept.

Not everything that can be counted counts, and not everything that counts can be counted. – William Bruce Cameron

Australian universities have been in the media in recent weeks for the dubious treatment of overseas students and the problem of plagiarism. But they are in serious trouble for another reason: their reliance on "bibliometrics" for major decision making.

Two international companies, Thomson Reuters and Elsevier, rate the apparent prestige of the journals in which academics' publications appear, and the frequency with which other authors refer to them, i.e. their citations. Two of the key summary results are the Hirsch index (or h-index), which reflects citations, and journal impact factor (JIF), claimed to reflect the importance of journals.

Ratings such as these dominate decisions on academic promotions, tenure, grant funding and the status of departments and universities. They have been universally adopted by universities in Australia because of perceived benefits of speed, cost-effectiveness and alleged objectivity. They underpin the government's Excellence in Research for Australia (ERA).

This is of immediate national interest because of the links between these metrics, academic rankings and government funding of science and the universities. Also the potential harm to careers and the very way research is carried out.

Internationally, opposition has taken the form of the San Francisco Declaration on Research Assessment (DORA) [PDF]. Institutions are urged to acknowledge that the scientific content of a paper is more important than publication metrics or the identity of the journal in which it was published.

Content rather than metrics is what ought to count.

http://theconversation.com/our-obsession-with-metrics-is-corrupting-science-39378


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 2) by Mr Big in the Pants on Tuesday June 02 2015, @09:01PM

    by Mr Big in the Pants (4956) on Tuesday June 02 2015, @09:01PM (#191268)

    You have a point. You might as well be using random noise: at least it won't unfairly benefit the liars and sociopaths.

    Metrics applied by bureaucratic bean counters have corrupted EVERYTHING they have ever come into contact with.

    So I am not sure why everyone is surprised. This was a problem at the university I worked in 10 years ago when they switched to this system at the government's behest.

    Not to say all metrics are bad, just the ones that are inevitably used by mouth breathers to give them a sense of control-by-spreadsheet.

    Starting Score:    1  point
    Karma-Bonus Modifier   +1  

    Total Score:   2