RSS 1.0 Feed
RSS 2.0 Feed
Atom Feed
 

Ten-Year Cross-Disciplinary Comparison of the Growth of Open
Access and How it Increases Research Citation Impact

Hajjem, C., Harnad, S. and Gingras, Y. (2005) Ten-Year Cross-Disciplinary Comparison of the Growth of Open
Access and How it Increases Research Citation Impact. IEEE Data Engineering Bulletin, 28 (4). pp. 39-47.

This is the latest version of this eprint.

Download

[img]
Preview
PDF
438Kb
[img]Other
2558Kb

Abstract

In 2001, Lawrence found that articles in computer science that were openly accessible (OA) on the Web were cited substantially more than those that were not. We have since replicated this effect in physics. To further test its cross-disciplinary generality, we used 1,307,038 articles published across 12 years (1992-2003) in 10 disciplines (Biology, Psychology, Sociology, Health, Political Science, Economics, Education, Law, Business, Management). We designed a robot that trawls the Web for full-texts using reference metadata (author, title, journal, etc.) and citation data from the Institute for Scientific Information (ISI) database. A preliminary signal-detection analysis of the robot's accuracy yielded a signal detectability d'=2.45 and bias = 0.52. The overall percentage of OA (relative to total OA + NOA) articles varies from 5%-16% (depending on discipline, year and country) and is slowly climbing annually (correlation r=.76, sample size N=12, probability p < 0.005). Comparing OA and NOA articles in the same journal/year, OA articles have consistently more citations, the advantage varying from 36%-172% by discipline and year. Comparing articles within six citation ranges (0, 1, 2-3, 4-7, 8-15, 16+ citations), the annual percentage of OA articles is growing significantly faster than NOA within every citation range (r > .90, N=12, p < .0005) and the effect is greater with the more highly cited articles (r = .98, N=6, p < .005). Causality cannot be determined from these data, but our prior finding of a similar pattern in physics, where percent OA is much higher (and even approaches 100% in some subfields), makes it unlikely that the OA citation advantage is merely or mostly a self-selection bias (for making only one's better articles OA). Further research will analyze the effect's timing, causal components and relation to other variables, such as, download counts, journal citation averages, article quality, co-citation measures, hub/authority ranks, growth rate, longevity, and other new impact measures generated by the growing OA database.

Creators:Chawki Hajjem, Stevan Harnad, Yves Gingras
Item Type:Article
Keywords:eprints, self-archiving, citation analysis, research impact, research funding, research assessment, institutional repositories, open access
Additional Information:Update correcting a misreported range for %OA and %OA advantage.
Research Group:Intelligence, Agents, Multimedia
Deposited On:15 Aug 2006 by Harnad, Stevan
Alternative Locations:http://sites.computer.org/debull/A05dec/hajjem.pdf
ID Code:12906
Last Modified:11 Nov 2009 12:28
Performance Indicator:EZ~03~01~12

Available versions of this item

Tools

Metadata

Download Statistics

Last month

Last year

Members of ECS may view the download statistics dashboard for this record.

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in this archive you will be forwarded to the paracite service. Poorly formated references will probably not work.

Bollen, J., Van de Sompel, H., Smith, J. and Luce, R. (2005) Toward alternative metrics of journal impact: A comparison of download and citation data. Information Processing and Management, 41(6): 1419-1440 http://arxiv.org/abs/cs.DL/0503007.

Brody, T., Harnad, S. and Carr, L. (2005, in press) Earlier Web Usage Statistics as Predictors of Later Citation Impact. Journal of the American Association for Information Science and Technology (JASIST). http://eprints.ecs.soton.ac.uk/10713/

Diamond, Jr. , A. M. (1986) What is a Citation Worth? Journal of Human Resources 21:200-15, 1986, http://www.garfield.library.upenn.edu/essays/v11p354y1988.pdf

Egan, J.P. (1975) Signal detection theory and ROC analysis. Academic Press. Garfield, E. (1955) Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas. Science, Vol:122, No:3159, p. 108-111

Garfield, E. (1955) Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas. Science 122 (3159): 108 http://www.garfield.library.upenn.edu/papers/science_v122(3159)p108y1955.html

Garfield, E. (1973) Citation Frequency as a Measure of Research Activity and Performance, in Essays of an Information Scientist, 1: 406-408, 1962-73, Current Contents, 5, http://www.garfield.library.upenn.edu/essays/V1p406y1962-73.pdf

Hajjem, C., Gingras, Y, Brody, T., Carr, L. & Harnad, S. (submitted) Open Access to Research Increases Citation Impact. http://www.ecs.soton.ac.uk/ harnad/Temp/hajjem-draft.doc

Harnad, S. (1994) A Subversive Proposal. In: Ann Okerson & James O'Donnell (Eds.) Scholarly Journals at the Crossroads: A Subversive Proposal for Electronic Publishing.Washington, DC., Association of Research Libraries, June 1995.http://www.arl.org/scomm/subversive/toc.html

Harnad, S., Carr, L., Brody, T. and Oppenheim, C. (2003) Mandated online RAE CVs linked to university eprint archives: Enhancing UK research impact and assessment. Ariadne, issue 35, April 2003 http://www.ariadne.ac.uk/issue35/harnad/

Harnad, S. & Brody, T. (2004) Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals, D-Lib Magazine 10 (6) June. http://www.dlib.org/dlib/june04/harnad/06harnad.html

Harnad, S., Brody, T., Vallieres, F., Carr, L., Hitchcock, S., Yves, G., Charles, O., Stamerjohanns, H. and Hilf, E. (2004) The Access/Impact Problem and the Green and Gold Roads to Open Access. Serials review 30(4). http://eprints.ecs.soton.ac.uk/10209/

Kurtz, Michael J.; Eichhorn, Guenther; Accomazzi, Alberto; Grant, Carolyn S.; Demleitner, Markus; Murray, Stephen S.; Martimbeau, Nathalie; Elwell, Barbara. (2003) The NASA Astrophysics Data System: Sociology, Bibliometrics, and Impact. Journal of the American Society for Information Science and Technology. http://cfa-www.harvard.edu/ kurtz/jasis-abstract.html

Kurtz, M. J. , Eichhorn, G. , Accomazzi, A. , Grant, C. S. , Demleitner, M. , Murray, S. S. (2004) The Effect of Use and Access on Citations, Information Processing and Management, 41 (6): 1395-1402 http://cfa-www.harvard.edu/ kurtz/IPM-abstract.html

Landauer, T. K., Foltz, P. W., & Laham, D. (1998). Introduction to Latent Semantic Analysis. Discourse Processes, 25, 259-284.

Lawrence, S, (2001) Online or Invisible?, Nature 411 (2001) (6837): 521. http://www.neci.nec.com/lawrence/papers/online-nature01/

Moed, H. F. (2005a) Citation Analysis in Research Evaluation. NY Springer.

Moed, H. F. (2005b) Statistical Relationships Between Downloads and Citations at the Level of Individual DocumentsWithin a Single Journal, Journal of the American Society for Information Science and Technology, 56(10): 1088-1097. http://www3.interscience.wiley.com/cgi-bin/abstract/110506743/ABSTRACT

Odlyzko, A. M. (2002) The rapid evolution of scholarly communication. Learned Publishing, 15(1), 7-19. http://www.dtc.umn.edu/ odlyzko/doc/rapid.evolution.pdf

Perneger, T. V. (2004) Relation between online 'hit counts' and subsequent citations: prospective study of research papers in the British Medical Journal. British Medical Journal 329:546-547. http://bmj.bmjjournals.com/cgi/content/full/329/7465/546

Smith, A. and Eysenck, M. (2002) The correlation between RAE ratings and citation counts in psychology Technical Report, Psychology, Royal Holloway College, University of London, June 2002. http://psyserver.pc.rhbnc.ac.uk/citations.pdf

Swan, A. and Brown, S. (2005) Open access self-archiving: An author study. JISC Technical Report. http://eprints.ecs.soton.ac.uk/10999/

Corrections

ECS staff and postgraduates may modify this record

Available Versions of this Item

  Welcome from Deputy Head of School (Research) Research Prospectus Industrial Partnerships New Research Students Notes for Guidance New Research Students Notes for Guidance
The ECS EPrints Repository supports OAI 2.0 with a base URL of http://eprints.ecs.soton.ac.uk/cgi/oai2

EPrints is free software developed by the University of Southampton to facilitate Open Access to research.
EPrints