Posts

Exploring Unreal 5 for Animatics/Previs

Image
A little summer project to explore quick ideation of a scene - using kitbashed assets and mixamo characters to make a short sequence... Unreal is proving to be a great tool to explore cinematography and lighting in a quick sandbox - there's lots of room to develop some teaching material around filmmaking using Unreal - as well as its own outputs for Virtual Production / Machinema as its own medium... 

Using a Gamepad to control a Tooll3 visual

Image
 Continuing to explore novel inputs for visuals - this is using an Xbox Wireless Controller... This was the intial test - using MJoy and LoopMidi to create the midi remapping from the joystick to be picked up as a midi device in Tooll3. The only limitation with MJoy - is that the window needs to be active to be sending an output... This next version is using the gamepad to change a fractal image - which is used to drive a ImagetoPoint operator in tool - as the starting point of the further repeats to make a 'nebula' type visual - that is controlled by both joysticks... The Graph Layout in Tool... Using MJoy - 1. setup up the joystick axis / button , and a unique midi control/note 2. Click the + to add this to your mapping of controls. Repeat...

Tooll3 to Unreal via Spout

Image
Using  Offworld's Streaming plugins  for Unreal, set up a spout receiver in unreal, to pick up the steam from Tooll using their spout output. Setting the unreal spout receiver to a render texture and using this in a custom masked material, adds the transparency and blend extra colours. To reduce the lag, Tooll was outputting 1024x1024px image as RGBA8bit.

More inputs to Tooll3 ( Leapmotion & ComfyUI/NDI )

Image
The quick setup of Tooll3, inspires creative play to think of ways to interface interactively with Visuals. As i get to learn the software, it's good to get old devices out and think about their potential. Great to see that my Leapmotion v1, that's been stuck in a box for years still works a treat. In this test , using Geco  which converts Leapmotion camera into gestures that can be outputted as Midi and LoopMidi to create a midi port to connect some outputs that can be picked up and trained in Tooll , to manipulate a realtime cube. Another exploration was following on with NDI outputs/inputs - this time from ComfyUI  with a custom NDI node to send a texture to Tooll3 - to explore a setup for GenerativeAI images used in Tooll3. With each nudge forward, keeping thoughts to how to virutally puppeteer content in the future.