Activity retrieval in closed captioned videos
| dc.contributor.advisor | Mooney, Raymond J. (Raymond Joseph) | en |
| dc.contributor.committeeMember | Grauman, Kristen | en |
| dc.creator | Gupta, Sonal | en |
| dc.date.accessioned | 2010-06-04T14:46:53Z | en |
| dc.date.available | 2010-06-04T14:46:53Z | en |
| dc.date.issued | 2009-08 | en |
| dc.date.submitted | August 2009 | en |
| dc.description | text | en |
| dc.description.abstract | Recognizing activities in real-world videos is a difficult problem exacerbated by background clutter, changes in camera angle & zoom, occlusion and rapid camera movements. Large corpora of labeled videos can be used to train automated activity recognition systems, but this requires expensive human labor and time. This thesis explores how closed captions that naturally accompany many videos can act as weak supervision that allows automatically collecting 'labeled' data for activity recognition. We show that such an approach can improve activity retrieval in soccer videos. Our system requires no manual labeling of video clips and needs minimal human supervision. We also present a novel caption classifier that uses additional linguistic information to determine whether a specific comment refers to an ongoing activity. We demonstrate that combining linguistic analysis and automatically trained activity recognizers can significantly improve the precision of video retrieval. | en |
| dc.description.department | Computer Science | |
| dc.format.mimetype | application/pdf | en |
| dc.identifier.uri | http://hdl.handle.net/2152/ETD-UT-2009-08-305 | en |
| dc.language.iso | eng | en |
| dc.subject | Activity Recognition | en |
| dc.subject | Action Recognition | en |
| dc.subject | Video Retrieval | en |
| dc.subject | Machine Learning | en |
| dc.subject | Computer Vision | en |
| dc.subject | Multimedia | en |
| dc.subject | Closed Captions | en |
| dc.title | Activity retrieval in closed captioned videos | en |
| dc.type.genre | thesis | en |
| thesis.degree.department | Computer Sciences | en |
| thesis.degree.discipline | Computer Sciences | en |
| thesis.degree.grantor | The University of Texas at Austin | en |
| thesis.degree.level | Masters | en |
| thesis.degree.name | Master of Arts | en |