MIT Libraries logoDSpace@MIT

MIT
View Item 
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Understanding social interpersonal interaction via synchronization templates of facial events

Author(s)
Hoque, Mohammed Ehasanul; Curhan, Jared R.; Li, Rui
Thumbnail
Downloadfd308f4f082285e3c74badd0252da1605524.pdf (4.999Mb)
OPEN_ACCESS_POLICY

Open Access Policy

Creative Commons Attribution-Noncommercial-Share Alike

Terms of use
Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/
Metadata
Show full item record
Abstract
Automatic facial expression analysis in inter-personal communication is challenging. Not only because conversation partners' facial expressions mutually influence each other, but also because no correct interpretation of facial expressions is possible without taking social context into account. In this paper, we propose a probabilistic framework to model interactional synchronization between conversation partners based on their facial expressions. Interactional synchronization manifests temporal dynamics of conversation partners' mutual influence. In particular, the model allows us to discover a set of common and unique facial synchronization templates directly from natural interpersonal interaction without recourse to any predefined labeling schemes. The facial synchronization templates represent periodical facial event coordinations shared by multiple conversation pairs in a specific social context. We test our model on two different dyadic conversations of negotiation and job-interview. Based on the discovered facial event coordination, we are able to predict their conversation outcomes with higher accuracy than HMMs and GMMs.
Date issued
2018-02
URI
http://hdl.handle.net/1721.1/120862
Department
Program in Media Arts and Sciences (Massachusetts Institute of Technology); Sloan School of Management
Journal
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18)
Publisher
AAAI Press
Citation
Li, Rui, Jared Curhan, Mohammed Ehsan Hoque. "Understanding Social Interpersonal Interaction via Synchronization Templates of Facial Events." Thirty-Second AAAI Conference on Artificial Intelligence (AAAI18), February 2-7, 2018, New Orleans, Louisiana.
Version: Author's final manuscript

Collections
  • MIT Open Access Articles

Browse

All of DSpaceCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

My Account

Login

Statistics

OA StatisticsStatistics by CountryStatistics by Department
MIT Libraries
PrivacyPermissionsAccessibilityContact us
MIT
Content created by the MIT Libraries, CC BY-NC unless otherwise noted. Notify us about copyright concerns.