Thanks for your reply @Jona

It looks like I am a little bit further than what you thought
I can display almost any (basic) things I want with ofelia, the problem is making abstraction and modularize the logic of Openframeworks/lua/ofelia in puredata.

Sorry for the name clash with Gem, I fixed it and proposed [gl.name] (Edit: [of.name]) objects now (The same name convention used in pd-ceammc, which is the perfect tool for workshop with students).

I've done a video player, video cam input etc... the files are updated in the main post.

I have also found a fix for the basic prim object and windows (re)creation crash. I guess the problem is primitive class instantiation that should be at setup time and not object creation time... but I am not sure.
It works for me this way but still thinking...

The tricky part of this project is that I want to have completely modularize objects + arguments + real time variable etc etc...

I just want to announce the update on my BlurPD system that is now at v3
Follow one of the links below to see more details and to download.

Hi everybody!

Getting my feet wet with Pure Data on the quest to find an environment that works well for interactive modular synth stuff with MPE compatible controllers.
On first sight I am quite impressed - particularly the "clone" object is really a relevation when it comes to managing several voices (compared to most other eurorack-style mono-voice-module modulars)!

Two questions:
Do we always have to create an abstraction (= a new file) when we want to clone something?
Have some cases where the cloned objects are so highly special that they only make sense within one particular parent patch and even there they occur only once. (E.g. have an "mpein" object for reading mpe midi data that uses a 16 times cloned, quite specialized mpein_channeltovoice" abstraction internally)
Can I somehow use a subpatch instead of an abstraction that is stored together with the main patch file?
(Not a big deal, might just be more convenient when sharing stuff to have one file instead of a bunch of them)

And assuming I have a synth with quite demanding calculations per voice - would it be possible to somehow combine pd~ and clone? E.g. to run 16 instances of an abstraction in parallel on 4 cores with four voices each?
(Also not a big thing if it doesn't work, I can always manually create 4 pd~ instances with "clone myvoiceabstraction 4" inside each. Would be convenient though not having to copy everything N times. Is still ok for 4 cores, but not so much fun for a 32 cores 64 threads CPU .)

@Jona Hi, I've been working on the connections but couldn't finish the implementation yet.
Although it should be possible to implement the connections and everything using the existing pd and ofelia objects, I personally think pd is not the easiest tool for handling such a complicated task where you need lots of conditions and state changes.

For this reason, I've been writing the code in openFrameworks and C++ first and then translated the code into pd objects which is not so efficient way of working.

Because of this, I'm considering to embed the scripting language Lua to ofelia (using Dan Wilcox's ofxLua) so users can mix text based scripting with visual programming in realtime. And users will be able to directly access all openFrameworks features using it. I think it can be very flexible if I succeed in adding the feature. And I believe it will help me to work more efficiently for creating the modular environment.

I expect it will take about a week or two to add the Lua scripting feature to ofelia. (if everything goes well)
Then I will need a few more days to study basics of the Lua programming language but it looks pretty easy to learn.

So if you're not in a hurry to create the modular environment, I suggest we hold off this project for a while until I finish creating the base of the environment after adding the Lua scripting feature.
My goal is to make it possible for you and users to easily design modules using ofelia's gui abstractions(e.g. pdgui) and inlet/outlet abstractions without having to deal with other things.

As I've said, this is a complicated project requiring a huge amount of work so I hope you understand my decision and I will keep you updated on my progress.

P.S : The below image is the screenshot of what I've done so far using openFrameworks/C++ which I didn't translate to pd and ofelia. I think the code can be easily translated to Lua later on.

@Jona Hi, I couldn't implement the cord connections yet since I'm currently busy with other thing.
Here's the so far work : modular.zip
I will be able to continue again from next Friday. Just wanted to let you know.

@Jona Yes the keycodes don't conflict with other keys. I will leave it like this then.
Thanks for your finding and suggestion. I applied the change. modular.zip Please check if it's working as expected.
And regarding the last question, I don't think it's currently possible to make the pop up window to appear front when using [openpanel] while ofelia window has focus. And I should note that [openpanel] and [savepanel] won't work if you use them on standalone app created with ofxOfelia. I think these objects are built using Tcl/Tk. And I don't know if there's a good cross-platform solution in openFrameworks(c++) for creating such objects.
What you can do now instead is creating a custom fake openpanel that appears inside ofelia window. It should be possible by using some utility objects. You can take a look at "file" and "directory" subpatches from "ofelia/help-intro.pd".

EDIT : fixed small minor bugs. modular.zip

@Jona Thanks for confirming. I also added 47 and 93 for zooming. modular.zip
Maybe I should change the shortcut for zooming later since -/+ seem to differ by platforms and hardwares.

@Jona Hi, the new lissajous sequencer module looks nice and seems to work well.
I added [ofKeyCodeListener] which outputs constant keycode values independent from modifier keys.
Please reinstall ofelia v1.0.8 so you can use this object.
Here's a new version modular.zip. Please try to delete boxes using the backspace key(or del key?) on Windows. If it doesn't work, please let me know the output value of [ofKeyCodeListener] when you press the backspace key. Also, Please let me know the output values of left/right Control keys.
Could you also try "Command + '-'/'+'" on your macbook to zoom? if it doesn't work properly please let me know the output value of [ofKeyCodeListener] when you press '-' and '+'.
And I fixed the position jumping issue when double click and drag a new box. Thanks for finding this.
Now I will try to work on the cord connections. Let me know if you find other issues or have suggestions.

@Jona Hi, I couldn't finish creating the demo yet. But I think I'm getting there.
Here's what I've done so far, modular.zip. You need to reinstall ofelia v1.0.8 since I made changes to [ofEditRect] today. (I added "assignPos" and "assignDimen" method)

When you open the "main.pd" patch, you will be able to create a box using Control + '1'. And delete the box using the "backspace" key.
Also, you can select/unselect multiple boxes while holding down the "shift" key. Or you can select boxes with the area selection.
And you can zoom in/zoom out the screen using Control + "-"/"+".
I only tested the patch on macOS so far. Let me know if you find any problem.
EDIT : It seems the keycode doesn't output correct value when pressed with Control key on Windows. (or it could be the problem of my macbook keyboard) I will find a way to fix this. Until then, you can try on macOS or modify the patch.

I tried to make it work just like Pd. I will try to implement the patch cord feature this week.
I would also need to implement the copy/cut/duplicate/paste/undo/redo feature later. (after patch cord is ready)
And I think typing the name to create module can be implemented later.
Also, I think it needs to have some kind of window expander later. (similar to the OF addon you showed me last time)

And I'm thinking to make 2 modes (editmode, playmode) just like Pd. On editmode, you can create/delete/move/connect modules but you cannot adjust the GUI. On playmode, you can only adjust the GUIs inside the module. (e.g. knob) It will be just like how Pd works.

Let me know if you like the above mentioned plan and design idea.

3dPd workshop in Athens!
Prototyping and finalizing modules for the 3dPd system!
Starting 2nd of December.

More info here http://www.spaceunder.com/education/modular-synthesizer/
3dPd demo