Overview
StreamDiffusion is a locally-hosted generative AI pipeline for interactively creating/modifying video streams. Within the XR Studio, it is used to demo generative AI's potential in the field of Virtual Production and world/content creation. This article will go over the setup this workflow in the XR Studio.
Setup & Configuration
As of June 2026, the Ansin 309 PC no longer uses Parsec to access the XR Studio servers, instead using a more direct KVM connection. Please see here for more information. This means Parsec is also no longer being used for this workflow.
- In disguise Designer, on the current Director server, go to the ai_stablediff-td track, and locate on the timeline the RenderStream layer titled RS: StreamDiffusion TD. Right-click on the layer, and Start Workload.
- Next, switch to the RXII-A server.
- There you should see the corresponding StreamDiffusion TouchDesigner project launching. Once launched, locate and left-click on the central StreamDiffusion node, then Pulse the Start Stream command.
- (Fix) There is a present issue with the TD project where the generated image is translated/shifted off-center due to the Fit1 node. Left-click on that node, find the Translate attribute under the node's Fit tab, and set the X value to 0, if you see it at 0.7.
- Additionally, if you notice the image isn't fitting correctly on the wall, try switching the Fit setting to another option, especially if it's defaulted to Fit Horizontal or adjust the scale/translation settings accordingly.
- Once you are finished, Pulse the Stop Stream command and feel free to quit the TouchDesigner project. The RenderStream should automatically stop in disguise.