Hi all,

So, we have access to [key], [keyup], etc. for keyboard input but I am wondering if we have access to an object that allows a user to control their computer keyboard from within a Pd patch? Is there an object that allows you to format arbitrary messages and pipe them externally to control your keyboard hardware? As an example, MIDI messages used to control keyboard shortcuts within a DAW.

Any help greatly appreciated, as always!

Ricky

Thanks. Are there any decent examples for the latter? 'xdotool' seems quite obscure.

@ricky
sudo apt-get install xdotool
xdotool mousemove 400 400

xdotool -h:
...
mousedown
mousemove
mousemove_relative
mouseup
...
xdotool mousemove -h

@EEight

Thanks for the nice example.

I get the following error: Warning: XTEST extension unavailable on '(null)'. Some functionality may be disabled; See 'man xdotool' for more info. Usage: mousemove [options] <x> <y>

Install issue? Can't seem to access 'man xdotool.'

O.K., I reinstalled macports and then used macports to reinstall 'xdotool.' I can now access 'man xdotool.' The application uses XQuartz / X11's XTEST extension to make stuff happen. The error seems to be with the XTEST extension on OSX. I will continue to search for answers, but for now, thanks to EEight for his help.

I did find this: http://xquartz.macosforge.org/trac/ticket/414 but not having any success, yet. Any ideas?

Also this: http://www.jedi.be/blog/2010/08/29/sending-keystrokes-to-your-virtual-machines-using-X-vnc-rdp-or-native/

The objective is to send something to the effect of 'xdotool search --name sibelius key home' to terminal from a Pd patch using [shell].

Useful links, so far:
https://www.macports.org/install.php
http://coolestguidesontheplanet.com/setting-up-os-x-mavericks-and-homebrew/ - alt. to mac ports.
http://xquartz.macosforge.org/trac/wiki/X112.7.5
http://www.semicomplete.com/projects/xdotool/
http://www.semicomplete.com/projects/xdotool/xdotool.xhtml#keyboard_commands

Here's some software doing the same thing as xdotool (linux), autoit (windows) on Mac:
http://stackoverflow.com/questions/3485254/equivalent-of-autoit-for-mac-os-x

Hope it helps
Cheers~

If you have any experience with Java or Processing you can try to make your own keyboard/mouse controller using the Java Robots class. This should work on any platform. If you use this with Processing you can easily drop in some OSC functionality and link it up with PD. I was able to use this technique along with the [fiddle~] object to play Quake with a saxophone and electric bass as the controller.

Info:
http://www.java-tips.org/java-se-tips/java.awt/how-to-use-robot-class-in-java.html
http://docs.oracle.com/javase/7/docs/api/java/awt/Robot.html

I do have experience with Processing. I will also try that. Good thinking.

I have been trying to compile [x11key] for OSX, although I am having trouble linking the necessary X11 files in Xcode:
http://forum.pdpatchrepo.info/topic/8665/compiling-x11key-for-osx

.... to play Quake with a saxophone and electric bass as the controller

Respect.

O.K., for anyone interested, I have compiled [x11key] for OSX (64 bit only). Many thanks to Antoine Villeret for his guidance. Darwin file is attached.

x11key.pd_darwin

Makefile

Update: xdotool / X11 / XQuartz is only useful for controlling applications which are X11 based. You could, for example, remotely control applications on a Linux based system using a Pd patch. Other than that, I was able to recreate a Processing sketch to achieve what I wanted. Thanks to Portbello for pointing me in the right direction.