TexasScholarWorks
    • Login
    • Submit
    View Item 
    •   Repository Home
    • UT Electronic Theses and Dissertations
    • UT Electronic Theses and Dissertations
    • View Item
    • Repository Home
    • UT Electronic Theses and Dissertations
    • UT Electronic Theses and Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Interactive learning from implicit human feedback : the EMPATHIC framework

    Thumbnail
    View/Open
    ZHANG-THESIS-2021.pdf (6.211Mb)
    Date
    2021-08
    Author
    Zhang, Qiping (M.S. in computer science)
    0000-0001-8157-0969
    Share
     Facebook
     Twitter
     LinkedIn
    Metadata
    Show full item record
    Abstract
    Reactions such as gestures and facial expressions are an abundant, natural source of signal emitted by humans during interactions. An autonomous agent could leverage an interpretation of such implicit human feedback to improve its task performance at no cost to the human, contrasting with traditional agent teaching methods based on demonstrations or other intentionally provided guidance. In this thesis, we first define the general problem of learning from implicit human feedback, and propose a data-driven framework named EMPATHIC as a solution, which includes two stages: (1) mapping implicit human feedback to corresponding task statistics; and (2) learning a task with the constructed mapping. We first collect a human facial reaction dataset while participants observe an agent execute a sub-optimal policy for a prescribed training task. Then, we train a neural network to instantiate and demonstrate the ability of the EMPATHIC framework to (1) infer reward ranking of events from offline human reaction data in the training task; (2) improve the online agent policy with live human reactions as they observe the training task; and (3) generalize to a novel domain in which robot manipulation trajectories are evaluated by the learned reaction mappings.
    Department
    Computer Sciences
    Subject
    Interactive learning
    Learning from human feedback
    URI
    https://hdl.handle.net/2152/94683
    http://dx.doi.org/10.26153/tsw/21602
    Collections
    • UT Electronic Theses and Dissertations

    University of Texas at Austin Libraries
    • facebook
    • twitter
    • instagram
    • youtube
    • CONTACT US
    • MAPS & DIRECTIONS
    • JOB OPPORTUNITIES
    • UT Austin Home
    • Emergency Information
    • Site Policies
    • Web Accessibility Policy
    • Web Privacy Policy
    • Adobe Reader
    Subscribe to our NewsletterGive to the Libraries

    © The University of Texas at Austin

     

     

    Browse

    Entire RepositoryCommunities & CollectionsDate IssuedAuthorsTitlesSubjectsDepartmentsThis CollectionDate IssuedAuthorsTitlesSubjectsDepartments

    My Account

    Login

    Statistics

    View Usage Statistics

    Information

    About Contact Policies Getting Started Glossary Help FAQs

    University of Texas at Austin Libraries
    • facebook
    • twitter
    • instagram
    • youtube
    • CONTACT US
    • MAPS & DIRECTIONS
    • JOB OPPORTUNITIES
    • UT Austin Home
    • Emergency Information
    • Site Policies
    • Web Accessibility Policy
    • Web Privacy Policy
    • Adobe Reader
    Subscribe to our NewsletterGive to the Libraries

    © The University of Texas at Austin