text by WEAVE partner UNL.

The UNL University team have published a scientific paper to be illustrated in a public event: Rui Rodrigues, Stephan Jürgens, Carla Fernandes, João Diogo and Nuno Correia will present their paper “Integrating 3D Objects in Multimodal Video Annotation” at IMX, the ACM International Conference on Interactive Media Experiences hosted by the University of Aveiro (Portugal) between the 22nd and 24th June 2022.

IMX is the leading international conference for presentation and discussion of research into interactive media experiences, and thus is the perfect place to present the work that WEAVE is carrying on to provide tools for enhanced collection’s management and reuse. The conference brings together international researchers and practitioners from a wide range of disciplines, ranging from human-computer interaction, multimedia engineering and design to media studies, media psychology and sociology.

The paper presents and discusses the introduction of 3D functionalities for an existing web-based multimodal video annotation tool available online at the CultureMoves website. Over the past years, the team has developed a multimodal web video annotation tool that now combines 3D models and 360º content with more traditional annotation types (e.g., text, drawings, images), offering users the possibility of adding extra information in their annotation work. The authors show how 3D models augment the annotation work and add advantages like viewing or exploring objects in detail and from different angles. The paper reports detailed feedback from a pilot study in the form of a workshop with traditional dance experts to whom these new features were presented. In the conclusion, the authors offer an outlook of future iterations of the video annotator based on the experts’ feedback.