Video Ontology @ Carnegie Mellon

"Video indexing suffers from inadequate metadata and an inability to derive reliable annotations automatically. In addition, there are no standards regarding how video should be indexed. Even for video that was born digital, there typically is insufficient metadata available. We develop a video indexing ontology that provides a large core set of primitives and relations for indexing video content across diverse domains. Complementing work done in the Library of Congress' Thesaurus of Graphic Materials, and MPEG-7 standardization efforts, we will study the theoretical and empirical aspects of the automatic detection of semantic concepts and their temporal and spatial relationships in video material informed by an indexing ontology."

http://www.informedia.cs.cmu.edu/ontology/index.html