Social Network Extraction and Analysis Based on Multimodal Dyadic Interaction

• Main Authors: Bogdan Raducanu, Sergio Escalera, Xavier Baró, Petia Radeva, Jordi Vitrià
• Format: Article
• Language: English
• Published: MDPI AG 2012-02-01
• Series: Sensors
• Subjects: social interaction; audio/visual data fusion; influence model; social network analysis
• Online Access: http://www.mdpi.com/1424-8220/12/2/1702/

Social interactions are a very important component in people’s lives. Social network analysis has become a common technique used to model and quantify the properties of social interactions. In this paper, we propose an integrated framework to explore the characteristics of a social network extracted from multimodal dyadic interactions. For our study, we used a set of videos belonging to New York Times’ Blogging Heads opinion blog. The Social Network is represented as an oriented graph, whose directed links are determined by the Influence Model. The links’ weights are a measure of the “influence” a person has over the other. The states of the Influence Model encode automatically extracted audio/visual features from our videos using state-of-the art algorithms. Our results are reported in terms of accuracy of audio/visual data fusion for speaker segmentation and centrality measures used to characterize the extracted social network.