Synaesthesia Gallery AR: Journey Through the Senses - Using Augmented Reality for Education
Citation:
Svetlana Rudenko and Mads Haahr, Synaesthesia Gallery AR: Journey Through the Senses - Using Augmented Reality for Education, Lecture Notes in Computer Science, Joint Conference on Serious Games (JCSG), Trinity College Dublin, Ireland, 26-27 October 2023, Mads Haahr, Alberto Rojas-Salazar and Stefan Goebel, 14309, Springer, 2023, 211 - 217Download Item:
Abstract:
This work-in-progress paper presents Synaesthesia Gallery AR: Journey Through the Senses, an educational game-like experience designed to bring awareness of synaesthesia, to learn and understand creativity of cross-modal perception. Synaesthesia is a perceptual trait characterised by cross-modal wiring of the brain experienced by a 4–6% of the population. Synaesthesia research has a long history (as far back as 1690), and sometimes synaesthesia was confused for hallucinations. The AR app documents creative synaesthesia experiences of individuals who have contributed significantly to synaesthesia research, including international artists, such as Carol Steen (president of USA Synaesthesia Association), and scientists, such as Jamie Ward (Professor at the University of Sussex, UK). Ramachandran and Hubbard have called synaesthesia “a window into perception, thought and language” that can help explain how the brain works. The app experience takes a form of an interactive digital gallery for the outdoors, a locative Augmented Reality (AR) art gallery with music by Liszt, Chopin, Schuman, Scriabin and others painted by artists-synaesthetes and music composed on art. The work is the result of a seven-year collaboration between artists-synaesthetes and pianist/researcher Dr Svetlana Rudenko. The app provides pleasing aesthetic experience as well as learning, to general population, neuroscience and psychology students, synaesthesia associations and music art lovers.
Author's Homepage:
http://people.tcd.ie/haahrm
Author: Haahr, Mads
Other Titles:
Lecture Notes in Computer ScienceJoint Conference on Serious Games (JCSG)
Publisher:
SpringerType of material:
Conference PaperCollections
Series/Report no:
14309;Availability:
Full text availableKeywords:
Augmented Reality, Synaesthesia, Music and Art, Creativity, Games for LearningSubject (TCD):
Creative Arts Practice , Creative Technologies , Digital EngagementMetadata
Show full item recordLicences: