Intranet Tools

nb. next round of REF2013 will NOT be using data from eprints.ecs, but the central university REF interface.

RSS 1.0 Feed
RSS 2.0 Feed
Atom Feed
 

ENHANCING LEARNING USING SYNCHRONISED MULTIMEDIA ANNOTATION

Wald, M., Wills, G., Millard, D., Gilbert, L., Khoja, S., Kajaba, J., Li, Y. and Singh, P. (2009) ENHANCING LEARNING USING SYNCHRONISED MULTIMEDIA ANNOTATION. In: EUNIS 2009: "IT: Key of the European Space for Knowledge", June 23rd to 26th, 2009, Santiago de Compostela, Spain.

Download

[img]
Preview
PDF
380Kb

Abstract

Audio and Video has become easier to record and store but while users can easily bookmark, search, link to, or tag the WHOLE of a recording available on the web (e.g. YouTube) they cannot easily find, or associate their notes or resources with, PART of that recording. This project therefore addresses the important user need of making multimedia web resources easier to access, search, manage, and exploit for learners, teachers and other users through developing Synote, a unique web based application that supports the collaborative creation of synchronised bookmarks called Synmarks, containing notes, tags and links. Synote has been developed using JAVA and the Google Web Toolkit and is able to play audio or video recordings stored by users on their chosen web accessible space. Since the Synote server only stores the text annotations, millions of hours of recordings can be catered for. The performance, efficiency and effectiveness of Synote was evaluated by using it with students and teachers for a number of undergraduate courses and this has shown that they like using Synote and want more recordings and lectures to be available in this way. Synote enables learners to: search text transcripts for specific topics and then replay recordings from that point; read captions to support learning style preference, deafness, or a second language; learn more easily from the colloquial style of transcribed text; insert a bookmark to be able to continue later from where they left off; link to sections of recordings from other resources or share these sections with others; tag and highlight sections of recordings/transcripts to revisit later for clarification; annotate recordings with notes and URLs of related resources to support revision; annotate recordings of group meetings to provide evidence for assessment. Synote enables teachers to: index their recordings using syllabus topic tags; provide synchronized slides and text captions to accompany podcasts; identify which topics need further clarification from learners’ notes and tags; provide feedback on learner-created recordings of presentations; tag recordings with URLs of related resources; link to and re-use sections of existing multimedia without having to edit the recording. A typical example scenario that demonstrates the use of Synote is:
"Mike records a narrated PowerPoint of his lecture and as the students are leaving his class he uploads this into Synote which automatically creates a clickable index from the slide titles and a transcript synchronised with the recording of his voice and the slides. He quickly adds some questions students should think about for next week as well as the URLs of some other resources (including a section of a recording he made the previous year) and synchronises these with the relevant parts of lecture. By the time Sally, one of Mike’s students, sits down at a computer all Mike’s material is available on the web allowing her to search the slides and text transcript and notes for specific topics and then replay the recording from that point, automatically highlighting currently spoken words. She annotates the recording at specific points with notes made from the text book to aid exam revision and also tags and highlights a section of the transcript she doesn't understand fully for Mike to clarify. Before going to lunch and logging off she prints out some information she wants to discuss with her group and inserts a synchronised bookmark into the recording to be able to continue later from where she left off."

Item Type:Conference or Workshop Item
Creator/Authors:
Mike Wald
Gary Wills
David Millard
Lester Gilbert
Shakeel Khoja
Jiri Kajaba
Yunjia Li
Priyanaka Singh
Research Group:Current ECS Groups > Web and Internet Science
Current ECS Groups > Electronic and Software Systems
Old ECS Groups > Learning Societies Lab
Date:2009
Information about this record:
Downloads (2010):39
ID Code:18218
Last Modified:23 Sep 2011 10:38
Deposited On:15 Nov 2009 12:45 by Wald, Mike

Tools & Metadata

Download Statistics

Last month

Last year

Members of ECS may view the download statistics dashboard for this record.

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in this archive you will be forwarded to the paracite service. Poorly formated references will probably not work.

Bain, K., Hines, J., Lingras, P., Yumei. Q. (2007) "Using Speech Recognition and Intelligent Search Tools to Enhance Information Accessibility" in Proceedings of HCI International In Lecture Notes in Computer Science series (LNCS)

Brotherton, J. A., Abowd, (2004) G. D. Lessons Learned From eClass: Assessing Automated Capture and Access in the Classroom, ACM Transactions on Computer-Human Interaction, Vol. 11, No. 2.

Chiu, P., Kapuskar, A., Reitmeief, S., Wilcox, L. (1999) NoteLook: taking notes in meetings with digital video and ink, Proceedings of the seventh ACM international conference on Multimedia (Part 1) 149 – 158.

Leitch, D., MacMillan, T. (2003) Liberated Learning Initiative Innovative Technology and Inclusion: Current Issues and Future Directions for Liberated Learning Research. Saint Mary's University, Nova Scotia. http://www.liberatedlearning.com/

Wald, M. (2006) Creating Accessible Educational Multimedia through Editing Automatic Speech Recognition Captioning in Real Time. International Journal of Interactive Technology and Smart Education: Smarter Use of Technology in Education 3(2) pp. 131-142.

Wald, M. (2007) A Research Agenda for Transforming Pedagogy and Enhancing Inclusive Learning through Synchronised Multimedia Captioned Using Speech Recognition. Proceedings of ED-MEDIA: World Conference on Educational Multimedia, Hypermedia & Telecommunications.

Wald, M. Bain, K. (2007) Enhancing the Usability of Real-Time Speech Recognition Captioning through Personalised Displays and Real-Time Multiple Speaker Editing and Annotation. In Proceedings of HCI International: 12th International Conference on Human-Computer Interaction, Beijing.

Whittaker, S., Hyland, P., Wiley, M. 1994 Filochat handwritten notes provide access to recorded conversations, Proceedings of CHI, 271-277.

Wilcox, L., Schilit, B., Sawhney, N. Dynomite, A. 1997: Dynamically Organized Ink and Audio Notebook, Proc. of CHI, 186–193

Corrections

ECS staff and postgraduates may modify this record

  Welcome from Deputy Head of School (Research) Research Prospectus Industrial Partnerships New Research Students Notes for Guidance New Research Students Notes for Guidance
The ECS EPrints Repository supports OAI 2.0 with a base URL of http://eprints.ecs.soton.ac.uk/cgi/oai2

EPrints is free software developed by the University of Southampton to facilitate Open Access to research.
EPrints