hi everyone, as I am quite new to pd and I am still not sure if this software is suitable for my project - until now I don't really find tutorials or patches, except for image mapping which is different to video. the goal is that the video 'makes' sound, not random but with parameters I determine. For examples certain kind of colours/pixels are a sinus tone or yellow is for gain, other pixels for other frequencies ect. My questions are is pd gem suitable for this? Second, If so, if it comes to video, how do I do the mapping, frame by frame? are there any patches?

hi ni
the video part in Pd can be handled by the Gem external. If you have that installed check the [pix_pix2sig~] object for a start.

@ni Hi and welcome to the forum. I haven't used gem yet but I think it should do what you are after. You can definitely load a video and play it frame-by-frame, and I'm pretty sure there are objects that allow you to extrapolate color information from images and frames. There are a few videos on youtube that should get you started with loading a video in Pd with gem, and from there you can go to the help menu > browser > gem and look at the help files for some objects, it should give you some examples and ideas.

@Johnny-Mauser & @weightless thank's for the answer. Apparently GEM is not working with my Version of Mac (10.13.5 high sierra)
https://github.com/umlaeute/Gem/wiki/How-to-build-Gem-on-macOS-Sierra-(10.12)
it's says it's possible to build GEM but I won't get video. than it doesn't really make sense. it's from 2017 and seems up to date?
are there solutions or updates?

@ni I also think that is quite frustrating. I also mostly work on OSX and am not updating for that exact reason. I did*t encounter the problem that way and i don't have a solution. Other than that Pd is really great. I would install a dual boot Linux just for Pd, or downgrade OSX in your case. Whereas Gem on OSX is still 32bit, which gives it a limited RAM access (up to 3Gb i believe) and on linux everything is 64 and nice as far as i know.

@ni I'm also on high sierra 10.13.5 and the version of gem I downloaded from help > find externals works just fine. It's the third from the top, Gem/0.93.3

@weightless good to know!