ECS Research
Publications
Intranet Tools

nb. next round of REF2013 will NOT be using data from eprints.ecs, but the central university REF interface.

RSS 1.0 Feed
RSS 2.0 Feed
Atom Feed
 

Open Access Scientometrics and the UK Research Assessment Exercise

Harnad, S. (2007) Open Access Scientometrics and the UK Research Assessment Exercise. Scientometrics, 73 (in pre). (In Press)

Warning

There is a more recent version of this eprint available. Click here to view it.

Download

[img] HTML
49Kb
[img] Microsoft Word
50Kb
[img]
Preview
 PDF
131Kb

Abstract

Scientometric predictors of research performance need to be validated by showing that they have a high correlation with the external criterion they are trying to predict. The UK Research Assessment Exercise (RAE) -- together with the growing movement toward making the full-texts of research articles freely available on the web -- offer a unique opportunity to test and validate a wealth of old and new scientometric predictors, through multiple regression analysis: Publications, journal impact factors, citations, co-citations, citation chronometrics (age, growth, latency to peak, decay rate), hub/authority scores, h-index, prior funding, student counts, co-authorship scores, endogamy/exogamy, textual proximity, download/co-downloads and their chronometrics, etc. can all be tested and validated jointly, discipline by discipline, against their RAE panel rankings in the forthcoming parallel panel-based and metric RAE in 2008. The weights of each predictor can be calibrated to maximize the joint correlation with the rankings. Open Access Scientometrics will provide powerful new means of navigating, evaluating, predicting and analyzing the growing Open Access database, as well as powerful incentives for making it grow faster.

Item Type:Article
Creator/Authors:
Stevan Harnad
Editors:
Wolfgang Glänzel
Henk Moed
Keywords:open access; scientometrics; research assessment exercise; RAE; citations; validity; multiple regression; psychometrics; factor analysis; research impact; metrics
Research Group:Current ECS Groups > Web and Internet Science
Old ECS Groups > Intelligence, Agents, Multimedia
Alternative Locations:http://arxiv.org/abs/cs.IR/0703131
Date:2007
Information about this record:
Performance Indicator:EZ~01~01~11
Citations:Google Scholar: 49
Downloads (2010):34
ID Code:14778
Last Modified:23 Sep 2011 10:35
Deposited On:04 Nov 2007 by Harnad, Stevan

Available versions of this item

Tools & Metadata

Download Statistics

Last month

Last year

Members of ECS may view the download statistics dashboard for this record.

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in this archive you will be forwarded to the paracite service. Poorly formated references will probably not work.

Brody, T. (2003) Citebase Search: Autonomous Citation Database for e-Print Archives. ECS Technical Report

http://eprints.ecs.soton.ac.uk/10677/

Brody, T., Harnad, S. and Carr, L. (2006) Earlier Web Usage Statistics as Predictors of Later Citation Impact. Journal of the American Association for Information Science and Technology (JASIST) 57(8) pp. 1060-1072.

http://eprints.ecs.soton.ac.uk/10713/

Garfield, E., (1955) Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas. Science 122: 108-111

http://www.garfield.library.upenn.edu/papers/science_v122(3159)p108y1955.html

Giles, C.L. , K. Bollacker, and S. Lawrence (1998) "CiteSeer: An Automatic Citation Indexing System," Digital Libraries 98: Third ACM Conf. on Digital Libraries, ACM Press, New York, 1998, pp. 89-98.

http://www.neci.nj.nec.com/homepages/lawrence/citeseer.html

Guédon, Jean-Claude, (2002) In Oldenburg’s Long Shadow: Librarians, Research Scientists, Publishers, and the Control of Scientific Publishing. Washington, DC: The Association of Research Libraries

http://www.arl.org/resources/pubs/mmproceedings/138guedon.shtml

Hajjem, C., Harnad, S. and Gingras, Y. (2005) Ten-Year Cross-Disciplinary Comparison of the Growth of Open Access and How it Increases Research Citation Impact. IEEE Data Engineering Bulletin 28(4) pp. 39-47.

http://eprints.ecs.soton.ac.uk/12906/

Harnad, S. (2006) Online, Continuous, Metrics-Based Research Assessment. Technical Report, ECS, University of Southampton.

http://eprints.ecs.soton.ac.uk/12130/

Harnad, S. & Brody, T. (2004) Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals, D-Lib Magazine 10 (6) June

http://www.dlib.org/dlib/june04/harnad/06harnad.html

Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) Mandated online RAE CVs Linked to University Eprint Archives: Improving the UK Research Assessment Exercise whilst making it cheaper and easier. Ariadne 35 (April 2003).

http://www.ariadne.ac.uk/issue35/harnad/

Hirsch, Jorge E., (2005), "An index to quantify an individual's scientific research output" Proceedings of the National Academy of Sciences 102(46) 16569-16572

http://www.pnas.org/cgi/content/abstract/102/46/16569

Kleinberg, Jon, M. (1999) Hubs, Authorities, and Communities. ACM Computing Surveys 31(4)

http://www.cs.brown.edu/memex/ACM_HypertextTestbed/papers/10.html

Kline, Paul (2000) The New Psychometrics: Science, Psychology and Measurement. Routledge

Lawrence, S. (2001) Online or Invisible? Nature 411 (6837): 521.

http://www.neci.nec.com/~lawrence/papers/online-nature01/

Landauer, T. K., Foltz, P. W., & Laham, D. (1998). Introduction to Latent Semantic Analysis. Discourse Processes, 25, 259-284.

Moed, H. F. (2005) Citation Analysis in Research Evaluation. NY Springer.

Oppenheim, Charles (1996) Do citations count? Citation indexing and the research assessment exercise, Serials, 9:155-61, 1996.

http://uksg.metapress.com/index/5YCDB0M2K3XGAYA6.pdf

Page, L., Brin, S., Motwani, R., Winograd, T. (1999) The PageRank Citation Ranking: Bringing Order to the Web.

http://dbpubs.stanford.edu:8090/pub/1999-66

Shadbolt, N., Brody, T., Carr, L. and Harnad, S. (2006) The Open Research Web: A Preview of the Optimal and the Inevitable, in Jacobs, N., Eds. Open Access: Key Strategic, Technical and Economic Aspects, chapter 21. Chandos.

http://eprints.ecs.soton.ac.uk/12453/

Corrections

ECS staff and postgraduates may modify this record

Available Versions of this Item

   Welcome from Deputy Head of School (Research) Research Prospectus Industrial Partnerships New Research Students Notes for Guidance New Research Students Notes for Guidance
The ECS EPrints Repository supports OAI 2.0 with a base URL of http://eprints.ecs.soton.ac.uk/cgi/oai2

EPrints is free software developed by the University of Southampton to facilitate Open Access to research.		 EPrints