HapticSOUND

An analysis, documentation and demonstration system for traditional musical instruments at the Cretan Ethnology Museum

Objectives

Our objectives

The project aims at the special objective of EPANEK “3.5 – Development and/or promotion of economic activity based on the natural capital and cultural heritage of Greece focusing on the field of Tourism” and more specifically at strengthening tourism by exploiting and highlighting the natural and cultural capital of our country.

Research Objectives

  • Ethnomusicological documentation of a representative part (lute, lyre and ascomandura) of the collection of the Museum of Cretan Ethnology (M.C.E)
  • Methodology: Literature research and on-site interviews with instrument players, instrument makers, etc. Recording of musical performances using Traditional Musical Instruments by traditional instrumentalists and research on collections of existing multimedia material.

  • Design of 3D models representing traditional musical instruments and 3D printing of copies in natural sizes. Study on how to make Traditional Musical Instruments with non-intrusive techniques.
  • Methodology: Research on the characteristics of Traditional Musical Instruments. Apply 3D scanning and optimize the result to produce natural size 3D prints.

  • Οntologies definition of the traditional musical instruments. Preparation of the multimedia data management platform (MDMP).
  • Methodology: Definition and validation of the data management system specifications. Registration of metadata and digital entities in MDMP.
  • Innovation: The Omeka open software platform will be used, which is specificaly designed for museums, libraries, archives and museum exhibitions.

  • Traditional musical instruments sound samples recording to create digital instrument’s copies
    Methodology: Definition of data management system specifications. Registration of metadata and digital entities in the MDMP.

User Oriented Objectives

  • Development of a Notification Subsystem based on gesture (haptic) recognition.
  • Methodology: Development of the gesture (haptic) recognition user interface using Leap Motion sensors. The classification will be based on Support Vector Machines (SVM) and Convolutional Neural Networks (CNN) techniques. Bone conduction technique will be used on research of issues of acoustic technology and audio transmission. A prototype model of a surface vibration transmition floor will be created.

  • Sound and audio installation study and analysis with bone conduction technology. Development of visitor’s interaction subsystem with natural size replicas of traditional musical instruments.
    Methodology: A visitor interaction subsystem will be developed, through a gesture (haptic) recognition interface using Time-of-Flight (ToF)
    depth cameras. A sensorimotor learning subsystem will be developed for user training.

  • Development of the creative entertainment subsystem
    Methodology: An educational game will be developed which will include a 3D puzzle of virtual traditional musical instruments assembling.

Contact

University of Macedonia,
156 Egnatia Street,
GR-546 36
Thessaloniki, Greece
Τηλ.: +30 2310 891868
hapticsound@uom.edu.gr

Follow us

Project Code:

Τ6ΥΒΠ-00397

Special Actions AQUACULTURE – INDUSTRIAL MATERIALS – OPEN INNOVATION IN CULTURE

HapticSOUND is co-financed by the European Union and Greek national funds