Monday, 15 July 2013

MFP - Daily Diary

Daily Diary

Date
Activity
Key Findings
15/07/13
Built a gesture system that provides constant audio feedback.
This will be one of many patches which will be used to test relationships between gesture and audio, in an attempt to establish the most effective at increasing player presence in an audio-game environment.
Inspired by the lightsaber sound in Starwars, I took inspiration from previous max/msp lightsaber creations and implemented them into my own gesture controlled version. I combined the constant sound, which changes in respect to its position in the virtual space with several one-shot sounds to provide feedback to 'significant gestural movements'.
15/07/2013
Developing ideas relating to the project outcome. Thinking of ways that I can fuse audio to gestures and how many gestures need to be tested
I currently have one gesture (a slap), which was developed for the audio-game prototype. However, to test the relationships of the different types of audio and gesture, I feel it will be beneficial to include more gestures to the audio-game. So one of the possible gestures I thought of could be a punch, which would require depth analysis of the image. However, webcams do not provide a x-axis (depth) which could be problematic when tracking a punch. So I have spent time trying to work around this and one method I am toying with is splitting the webcam image into a grid of 8X6 with the idea being if the tracked gesture is in a small amount of boxes it is far away and the more boxes that are filled with the gesture.. the closer the gesture is. So far the theory isn't producing the results intended as it is only acknowledging individual boxes rather than multiple. Further development and research required.
15/07/13
Further reading - 
GESTURE, SOUND AND PLACE, A max/msp mapping toolbox
Gesture, sound and place relates in somewhat to my research as the workshop provides the participant with an opportunity to change audio through gestural expression.

A max/msp mapping toolbox discusses the possibilities of mapping gestures via a series of equations relating to a matrix or matrices 
15/07/13Audio/Game related forum research - Engaging in discussions & Conducted a search to find issues surrounding immersion in audio-games, lack of physical engagement and further knowledge of audio-game releases.

Will be aiming to produce one of these daily diary tables everyday, whilst posting backlogged posts relating to the development of my work.

No comments:

Post a Comment