BIBLIOS

Document type
Conference papers

Document subtype
Full paper

Title
Happy or Sad, Smiling or Drawing: Multimodal Search and Visualisation of Movies Based on Emotions Along Time

Participants in the publication
Francisco Caldeira (Author)
FACULDADE DE CIÊNCIAS DA UNIVERSIDADE DE LISBOA
João Lourenço (Author)
FACULDADE DE CIÊNCIAS DA UNIVERSIDADE DE LISBOA
Teresa Chambel (Author)
LASIGE

Summary
Movies are a powerful vehicle for culture and education and one of the most important and impactful forms of entertainment, largely due to the significant emotional impact they have on the viewers, in our lives. Technology has been playing an important role, by making a huge amount of movies more accessible in pervasive services and devices, and helping in emotion recognition and classification. As such, it is becoming more pertinent the ability to search, visualize and access movies based on their emotional impact, although emotions are seldom taken into account in these systems. In this paper, we characterize the challenges and approaches in this scenario, then present and evaluate interactive means to visualize and search movies based on their dominant and actual emotional impact along the movie, with different models and modalities. In particular through emotional highlights in words, colors, emojis and trajectories, by drawing emotional blueprints or through users’ emotional states, with the ability to get us into a movie in serendipitous moments.


Event
Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP/HUCAPP) Human Computer Interaction Theory and Applications

Publication Identifiers

Address
Lisbon, Portugal

Publisher
SCITEPRESS - Science and Technology Publications


Document Identifiers
DOI - https://doi.org/10.5220/0011896400003417
URL - http://dx.doi.org/10.5220/0011896400003417

Awards
Best Paper Award

Rankings
CORE B (2021)