SignGuide: Automated Museum Guidance using Sign Language

The right for equal access to educational and cultural content is described in the european chart for human rights. However, there is practically very limited availability of accessible cultural museum content for the deaf.

The goal of the SignGuide project is to develop a prototype interactive museum guide system for deaf visitors using mobile devices that will be able to receive visitors' questions in their native (sign language) with regard to the exhibits, and to provide additional content also in sign language using an avatar or video, utilizing techniques from the field of computer vision and machine learning.

To this end, we will develop a demonstration system for guidance in the Archaeological Museum of Thessaloniki. System integration and commercial exploitation will be done through MLS Information Technology. The development of the tracking system and avatar will be developed by the Foundation for Research and Technology - Hellas, Computer Vision and Robotics Lab and Human Computer Interaction Lab respectively. Users will deaf from the Deaf Studies Unit of the University of Patras. The Signal Processing and Telecommunications Lab of the University of Patras will implement the machine learning algorithms and Cultural Technology Lab of the same university will organize the content and will coordinate the project.

This work is partially supported by the Greek Secretariat for Research and Technology, and the EU, Project T2EΔK-00982 within the framework of “Competitiveness, Entrepreneurship and Innovation” (EPAnEK) Operational Programme 2014-2020

Dimitrios Kosmopoulos: Principal Investigator and project coordinator.