Here Hear is an app that translates vision into melody.
Its a camera app that uses color contrasts and edge detection to recognize shapes around you. Point the camera anywhere to see the visual structure of what you see.
The second part is the sound of those shapes. Each generated shape has its own color, and each corresponds with a note. There are 12 notes related to the 12 colors of the app.
On first tap, the image freezes and a timeline starts moving across the image. Every time this timeline hits a shape, you hear a tone.
Its a tool for finding melodies in a visual way. Instead of using traditional musical instruments, which are usually played based on your decision, Here Hear can help you find melodies that are floating around you.
Here Hear is an app by visual artist Rafaël Rozendaal: www.newrafael.com
It was created to accompany the book Everything Always Everywhere, published by Valiz, available here: www.newrafael.com/book
Code by Tibor Udvari