Here are two patches I made for sonifying pictures and videos. I've tried to label the controls to make them easier to use.
Pictures (patch attached to this post) - this one makes sound from the RGB pixel value the mouse is hovering over. It was made to be controlled with a Wiimote but you can just use a mouse.
Videos (patch attaced to next post) - this one makes sound from the average HSV values per video frame. Also uses blob detection to sonify the spatial location of objects.
They both output MIDI too so you can send them out of Pd for sound (which is especially good for the video one because it struggles with sound and video rendering at the same time)
You can download reports with details of the patches and how they work, video demos and the GlovePIE script for the Wiimote controller here: http://alexjonesaudio.co.uk/sonification.html
aj647 posted in patch~ • read more