README

InMERSE Framework

Framework for multimodal gestural input. You can use it to develop applications that are independent from gesture-recognition devices and gesture-recognition methods.

This is an ongoing project, and help to improve it and complete is welcomed.

Code under the LGPL license: https://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License

The concepts and description are found in paper: "Separating Gesture Detection and Application Control Concerns with a Multimodal Architecture", by Morgado et al. (2015), presented at the VEAI workshop of the 2015 IEEE IUCC conference. https://www.researchgate.net/publication/283343525_Separating_Gesture_Detection_and_Application_Control_Concerns_with_a_Multimodal_Architecture

This framework was originally created as part of project InMERSE, developed in Portugal, at the INESC TEC research lab, with the cooperation and funding of PT Inovação (now Altice Labs).

Background on what can be achieved is provided in early (no software) papers:

• Morgado, Leonel (2014). Cultural Awareness and Personal Customization of Gestural Commands Using a Shamanic Interface, Procedia Computer Science, 27, 449 - 459. http://www.sciencedirect.com/science/article/pii/S1877050914000519

• Morgado, Leonel et al. (2015). Cities in Citizens’ Hands, Procedia Computer Science, 67, 430 - 438. https://www.researchgate.net/publication/278023915_Cities_in_citizens_hands

Contacts

INESC TEC

Luís Fernandes - lfernandes@utad.pt Ricardo Rodrigues Nunes - rrnunes@utad.pt

Universidade Aberta

Leonel Morgado - leonel.morgado@uab.pt

Universidade de Trás-os-Montes e Alto Douro

Hugo Paredes - hparedes@utad.pt Luís Barbosa - lfb@utad.pt Paulo Martins - pmartins@utad.pt Benjamim Fonseca

AlticeLabs

Fausto de Carvalho - cfausto@telecom.pt Bernardo Cardoso - bernardo@telecom.pt