The principle point of all the projects at Lab of Misfits – including our apps – is to enable people to ‘see themselves see’ or, to put it another way, to place people in the position of experiencing themselves literally making sense of the world.
And how better to do this than to experience one sense – light – in terms of another sense – sound, or vice versa. Building on our research into virtual synaesthesia (the creation of artificial synaesthetic experiences), we have developed apps to help you do just that. And, in the process, we hope that you will see life differently, which in turn creates new possibility for thinking and doing… and playing.
What does the visual world sound like? Could you navigate through a coloured space using only your ears? What kinds of new games could you create if only you had a device that turns lightness into sound?
Our SoundSeeer app lets you do all three… and more. The application was developed for Lab of Misfits' first i,scientistprogramme, and is a collaboration between Lab of Misfits and Mick Grierson’s lab at Goldsmiths University.
To download SoundSeeer, click here
The aim of this game is to keep a ball from hitting the ground by either catching it or bouncing it on your paddle. Except, in this game, you can’t see the ball… you can only hear it. Bing Bong, then, enables you to hear your visual world and in doing so see life differently. (Headphones required.).
To download Bing Bong, click here
Imagine being able to take a picture of your friend, and then compose music from the colours of their face. Now you can, with the Musical Images app developed by Lab of Misfits. Indeed, Musical Images lets you turn any image into sound. Whether that sound is musical is really up to you and your creativity.
The intrigue of this app is the ability to interact with images in a different way, to think about images not as representations of the world but as abstract information where new relationships are there to be discovered and created. By taking images of the world and ‘playing’ with them in sound, the structures in the images – a person’s face, a landscape, etc – lose their historical meaning, and instead become both a musical instrument and score. In doing this, the person playing with the programme actually takes on the role of observing themselves creating new and meaningful relationships that previously didn’t exist… which we call ‘seeing yourself see’.
To download Musical Images, click here
Musical Images is also available as a web app. More