Factorial Hidden Markov Models for full and weakly supervised supertagging

Repository

Factorial Hidden Markov Models for full and weakly supervised supertagging

Show full record

Title: Factorial Hidden Markov Models for full and weakly supervised supertagging
Author: Ramanujam, Srivatsan
Abstract: For many sequence prediction tasks in Natural Language Processing, modeling dependencies between individual predictions can be used to improve prediction accuracy of the sequence as a whole. Supertagging, involves assigning lexical entries to words based on lexicalized grammatical theory such as Combinatory Categorial Grammar (CCG). Previous work has used Bayesian HMMs to learn taggers for both POS tagging and supertagging separately. Modeling them jointly has the potential to produce more robust and accurate supertaggers trained with less supervision and thereby potentially help in the creation of useful models for new languages and domains. Factorial Hidden Markov Models (FHMM) support joint inference for multiple sequence prediction tasks. Here, I use them to jointly predict part-of-speech tag and supertag sequences with varying levels of supervision. I show that supervised training of FHMM models improves performance compared to standard HMMs, especially when labeled training material is scarce. Secondly, FHMMs trained from tag dictionaries rather than labeled examples also perform better than a standard HMM. Finally, I show that an FHMM and a maximum entropy Markov model can complement each other in a single step co-training setup that improves the performance of both models when there is limited labeled training material available.
Department: Computer Sciences
Subject: Hidden Markov Models Bayesian Models Categorial Grammar Supertagging Joint Inference
URI: http://hdl.handle.net/2152/ETD-UT-2009-08-350
Date: 2009-08

Files in this work

Download File: RAMANUJAM-THESIS.pdf
Size: 356.1Kb
Format: application/pdf

This work appears in the following Collection(s)

Show full record


Advanced Search

Browse

My Account

Statistics

Information