ECS Research
Publications
Intranet Tools
RSS 1.0 Feed
RSS 2.0 Feed
Atom Feed
 

Evaluating Citebase, an open access Web-based citation-ranked search and impact discovery service

Hitchcock, S., Woukeu, A., Brody, T., Carr, L., Hall, W. and Harnad, S. (2003) Evaluating Citebase, an open access Web-based citation-ranked search and impact discovery service. Technical Report ECSTR-IAM03-005, Electronics and Computer Science, University of Southampton. (Unpublished)

Download

[img]
Preview
PDF
363Kb

Abstract

Citebase is a new citation-ranked search and impact discovery service that measures citations of scholarly research papers which are openly accessible on the Web, i.e. papers that are assessable continuously online. Other services, such as ResearchIndex, have emerged in recent years to offer citation indexing of Web research papers. In the first detailed user evaluation of an open access Web citation indexing service, Citebase has been evaluated by nearly 200 users from different backgrounds. The paper details the procedures used in the evaluation, and analyses the results of this study, which took place between June and October 2002. It was found that within the scope of its primary components, the search interface and services available from its rich bibliographic records, Citebase can be used simply and reliably for the purpose intended, and that it compares favourably with other bibliographic services. It is shown tasks can be accomplished efficiently with Citebase regardless of the background of the user. More data need to be collected and the process refined before it is as reliable for measuring citation impact of indexed papers. Better explanations and guidance are required for first-time users. Coverage is seen as a limiting factor, even though Citebase indexes over 200,000 papers from arXiv. Non-physicists were frustrated at the lack of papers from other sciences. The principle of citation searching of open access archives has thus been demonstrated and need not be restricted to current users. Since the evaluation, Citebase has become a featured service of the ArXiv physics eprint archives.

Creators:Steve Hitchcock, Arouna Woukeu, Tim Brody, Les Carr, Wendy Hall, Stevan Harnad
Item Type:Technical Report
Research Group:Intelligence, Agents, Multimedia
Deposited On:19 Sep 2003 by Woukeu, Arouna
ISBN:0854 32798 3
ID Code:8204
Last Modified:07 Jan 2010 07:56
Performance Indicator:EZ~06~06~15

Tools

Metadata

Download Statistics

Last month

Last year

Members of ECS may view the download statistics dashboard for this record.

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in this archive you will be forwarded to the paracite service. Poorly formated references will probably not work.

Bergmark, Donna (2000) "Automatic Extraction of Reference Linking Information from Online Documents".

Cornell University Technical Report, TR 2000-1821, November

http://www.cs.cornell.edu/cdlrg/Reference%20Linking/extraction.pdf

Bergmark, D. and Lagoze, C. (2001) "An Architecture for Automatic Reference Linking". Cornell University Technical Report, TR2001-1842, presented at the 5th European Conference on Research and Advanced Technology for Digital Libraries (ECDL), Darmstadt, September

http://www.cs.cornell.edu/cdlrg/Reference%20Linking/tr1842.ps

Bollen, Johan and Rick Luce (2002) "Evaluation of Digital Library Impact and User Communities by Analysis of Usage Patterns". D-Lib Magazine, Vol. 8, No. 6, June

http://www.dlib.org/dlib/june02/bollen/06bollen.html

Chen, C. and Carr, L. (1999) "Trailblazing the literature of hypertext: An author co-citation analysis (1989-1998)". Proceedings of the 10th ACM Conference on Hypertext (Hypertext '99), Darmstadt, February

http://www.ecs.soton.ac.uk/~lac/ht99.pdf

Crow, R. (2002) "The Case for Institutional Repositories: A SPARC Position Paper". Scholarly Publishing & Academic Resources Coalition, Washington, D.C., July

http://www.arl.org/sparc/IR/ir.html

Darmoni, Stefan J., et al. (2002) Reading factor: a new bibliometric criterion for managing digital libraries. Journal of the Medical Library Association, Vol. 90, No. 3, July

http://www.pubmedcentral.gov/picrender.fcgi?action=stream&blobtype=pdf&artid=116406

Garfield, Eugene (1994) "The Concept of Citation Indexing: A Unique and Innovative Tool for Navigating the Research Literature". Current Contents, January 3rd

http://www.isinet.com/isi/hot/essays/citationindexing/1.html

Guédon, Jean-Claude (2001) "In Oldenburg's Long Shadow: Librarians, Research Scientists, Publishers, and the Control of Scientific Publishing". ARL Proceedings, 138th Membership Meeting, Creating the Digital Future, Toronto, May

http://www.arl.org/arl/proceedings/138/guedon.html

Gunn, Holly (2002) "Web-based Surveys: Changing the Survey Process". First Monday, Vol. 7, No. 12, December

http://firstmonday.org/issues/issue7_12/gunn/index.html

Gutteridge, Christopher (2002) "GNU EPrints 2 Overview". Author eprint, Dept. of Electronics and Computer Science, Southampton University, October, and in Proceedings 11th Panhellenic Academic Libraries Conference, Larissa, Greece, November

http://eprints.ecs.soton.ac.uk/archive/00006840/

Harnad, S. (2001) "Why I think research access, impact and assessment are linked". Times Higher Education Supplement, Vol. 1487, 18 May, p. 16

http://www.cogsci.soton.ac.uk/~harnad/Tp/thes1.html (extended version)

Harnad, S. (2002) "UK Research Assessment Exercise (RAE) review". American Scientist September98-Forum, 28th October

http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/2325.html

Harnad, Stevan, Les Carr, Tim Brody and Charles Oppenheim (2003) "Mandated online RAE CVs Linked to University Eprint Archives". Ariadne, issue 35, April

http://www.ariadne.ac.uk /issue35/harnad/intro.htm

Hitchcock, Steve (2003) "Metalist of open access eprint archives: the genesis of institutional archives and independent services". Submitted to ARL Bimonthly Report

Hitchcock, Steve, Donna Bergmark, Tim Brody, Christopher Gutteridge, Les Carr, Wendy Hall, Carl Lagoze, Stevan Harnad (2002) "Open Citation Linking: The Way Forward". D-Lib Magazine, Vol. 8, No. 10, October

http://www.dlib.org/dlib/october02/hitchcock/10hitchcock.html

Hitchcock, S. et al. (2000) "Developing Services for Open Eprint Archives: Globalisation, Integration and the Impact of Links". Proceedings of the Fifth ACM Conference on Digital Libraries, June (ACM: New York), pp. 143-151

http://opcit.eprints.org/dl00/dl00.html

Hitchcock, S. et al. (1998) "Linking Electronic Journals: Lessons from the Open Journal Project". D-Lib Magazine, December

http://www.dlib.org/dlib/december98/12hitchcock.html

Hunt, C. (2001) "Archive User Survey". Final year project, ECS Dept, University of Southampton, May

http://www.eprints.org/results/

Kurtz, M. J., G. Eichorn, A. Accomazzi, C. Grant, M. Demleitner, S. S. Murray, N. Martimbeau, and B. Elwell (2003) "The NASA astrophysics data system: Sociology, bibliometrics, and impact". Author eprint, submitted to Journal of the American Society for Information Science and Technology

http://cfa-www.harvard.edu/~kurtz/jasist-submitted.ps

Lawrence, Steve (2001) "Free Online Availability Substantially Increases a Paper's Impact". Nature Web Debate on e-access, May

http://www.nature.com/nature/debates/e-access/Articles/lawrence.html

Lawrence, S., Giles, C. L. and Bollacker, K. (1999) "Digital Libraries and Autonomous Citation Indexing". IEEE Computer, Vol. 32, No. 6, 67-71

http://www.neci.nj.nec.com/~lawrence/papers/aci-computer98/

Lynch, Clifford A. (2001) "Metadata Harvesting and the Open Archives Initiative". ARL Bimonthly Report, No. 217, August

http://www.arl.org/newsltr/217/mhp.html

Merton, Robert (1979) "Foreward". In Garfield, Eugene Citation Indexing: Its Theory and Application in Science, Technology, and Humanities (New York: Wiley), pp. v-ix http://www.garfield.library.upenn.edu/cifwd.html

Nielsen, Jakob (2000) "Why You Only Need to Test With 5 Users". Alertbox, March 19th

http://www.useit.com/alertbox/20000319.html

Small (1973) "Co-citation in the Scientific literature: A New Measure of the Relationship Between Two Documents". Journal of the American Society for Information Science, Vol. 24, No. 4, July-August;

reprinted in Current Contents, No. 7, February 13th, 1974,

http://www.garfield.library.upenn.edu/essays/v2p028y1974-76.pdf

Suber, Peter (2003) "Removing the Barriers to Research: An Introduction to Open Access for Librarians". College & Research Libraries News, 64, February, 92-94, 113

http://www.earlham.edu/~peters/writing/acrl.htm

Suber, Peter (2002) "Larger FOS ramifications". FOS-Forum list server, 2nd July

http://www.topica.com/lists/fos-forum/read/message.html?mid=904724922&sort=d&start=240

Van de Sompel, H. and Lagoze, C. (2002) "Notes from the Interoperability Front: A Progress Report from the Open Archives Initiative". 6th European Conference on Research and Advanced Technology for Digital Libraries (ECDL), Rome, September

http://lib-www.lanl.gov/%7Eherbertv/papers/ecdl-submitted-draft.pdf

Young, Jeffrey R. (2002) "Superarchives' Could Hold All Scholarly Output". Chronicle of Higher Education, July 5th

http://chronicle.com/free/v48/i43/43a02901.htm

Corrections

Repository Staff Only: item control page

   Welcome from Deputy Head of School (Research) Research Prospectus Industrial Partnerships New Research Students Notes for Guidance New Research Students Notes for Guidance
The ECS EPrints Repository supports OAI 2.0 with a base URL of http://eprints.ecs.soton.ac.uk/cgi/oai2

EPrints is free software developed by the University of Southampton to facilitate Open Access to research.		 EPrints