University of Maryland, Baltimore County
Mathematics/Psychology : 412
Date & Time
March 15, 2024, 2:00 pm – 3:00 pm
Title: Multimodal Machine Learning and Analytics for Characterizing Parent-Child Interactions: Applications in Education and Social Works
Abstract: Human-human interactions are fascinating and complex phenomena. However, it is notoriously difficult to study, given the dynamic and multimodal (e.g., audio, verbal, and visual) nature of the interactions. Modern sensors and the computational capability offered by AI/machine learning allow us to process and analyze fine-grained multimodal interaction data at a large scale. In this talk, I will share two studies that characterize and model parent-child interactions using audio/video data recordings, one in math education and another in early childhood parenting intervention contexts. I will discuss the various analytical methods used to derive insights and the implications for designing AI-supported coaching systems for realizing societal impacts at a large scale. I will also examine the challenges of working with multimodal interaction data.