...

Project Plan

ProjectPlanMarch2009

ProjectPlanMarch2009ProjectPlanMarch2009

Spoken Lecture Project

The Spoken Lecture Project processes video to create a transcript and/or segmented video to enable the two to be linked via a project-developed browser. Through the Spoken Lecture browser one can search for a term/phrase, select the video to watch, view the transcript and control the video by selecting within the transcript. The current browser implementation uses Real video. The current technology resides on and runs from Jim Glass' research cluster in the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL).

...

The technology requires any number of documents (e.g, existing transcripts, text from slides, research papers, indexes from textbooks, etc.) that are used to create a or augment an existing domain model, in addition to the input video. The domain model is critical for speech recognition, transcript development and ultimately video segmentation for search and retrieval. (Research has shown the poor overlap between existing speech recognition dictionaries and the terms used in typical science and engineering academic lectures.) The technology can be used to create a speaker model as well.

Collaborators

CSAIL: James (Jim) Glass, Scott Cyphers

OEIT: Brandon Muramatsu, Andrew McKinney, Peter Wilkins

University of Queensland: Phil Long, John Zornig

Contacts/Clients

This is a list of potential partners and/or clients