TouchDesigner & Unreal: Interactive Controllers

Learn how to use real-time controllers to drive great results from two fantastic real-time 3D graphic systems—TouchDesigner and Unreal Engine.

Introduction

• Welcome
• How to use the exercise files

1. TouchDesigner: MIDI

• MIDI device mapper
• MIDI input component
• Build effects UI
• Connect MIDI to effects UI
• Effects 1: Blur
• Effects 2: RGB
• Effects 3: Feedback, part 1
• Effects 3: Feedback, part 2
• Effects 3: Feedback, part 3

2. TouchDesigner: OSC

• OSC overview
• TouchOSC layout
• OSC input component
• Controlling objects with OSC
• Particles: Instancing, part 1
• Particles: Instancing, part 2
• Particles: Instancing, part 3
• Particles: Instancing, part 4
• Particles: GPU, part 1
• Particles: GPU, part 2
• Particle type switching with OSC

3. TouchDesigner: Kinect

• Kinect setup
• Kinect input component
• Connecting Kinect data to network, part 1
• Connect Kinect data to network, part 2

4. Unreal Engine: MIDI

• Blueprint 1: Listing MIDI devices
• Blueprint 2: Printing out incoming data
• Post-process material
• Blueprint 3: Data to parameter 1
• Blueprint 4: Data to parameters 2 & 3

5. Unreal Engine: OSC

• Install VS and download the plugin
• Create a C++ Unreal projects and compile a plugin
• TouchOSC: UI Layout
• Blueprint 1: OSC input
• Blueprint 2: Moving geometry
• Blueprint 3: Switching geometry
• Blueprint 4: Rotating geometry
• Blueprint 5: Moving particles

6. Unreal Engine: Kinect

• Installing the Kinect 4 Unreal plug-in
• Blueprint 1: Kinect input
• Blueprint 2: Object movement
• Blueprint 3: Particle movement
• Blueprint 4: Adding in right hand

Conclusion

• Next steps