1. Emerson College Technology & Media
  2. Post Production and Emerging Media
  3. Virtual Production

XR Studio & Virtual Production

Overview

Virtual Production is the intersection & combination of several technologies such as, LED panels/volumes, real time rendering, camera tracking, and live compositing, allowing you to place your actors into another world, combining the real and virtual, directly within the camera.

Corrections and adjustments normally made in Post Production can now be made directly within the camera, whether during Production or even as testing/iteration in the Pre-Production process.

Where previously chroma keying would require separate generation/placement of a virtual environment, now can be displayed on an LED screen backdrop in tandem with a live-composited virtual set. Where spill and reflections would need to be manually fixed and placed respectively in Post, you can now get in-camera environment-based reflections with LED Screen(s) serving as lighting instruments. This is all known as In-Camera Visual Effects (ICVFX).

Facility & Equipment Information

The EML XR Studio (Ansin 309) is a multi-functional space that can either be used as a space/classroom extension to the Ansin 312 Lab or as a separate production space. These modalities can be set using the foldable wall partition between Ansin 312 and Ansin 309.

The XR Studio is utilized for multiple purposes such as observational/analytical drawing, virtual reality content development, volumetric video capturing, and now: virtual production. While virtual production is a recent addition of the Studio’s capabilities, it is not a space solely dedicated to it.

For the Studio, reservation priority remains based on curricular use. In other words, primarily Emerging Media related production classes and approved MFA/BFA/BA thesis capstones have priority reservation access. All other use cases (i.e. extracurriculars) are handled on a case-by-case basis each semester. Access for the prior existing functionalities of the space remains the same. However, utilizing Ansin 309 as a Virtual Production/XR Studio space requires additional training, communication and approval in order for such requests to be properly accommodated for and to ensure safety.

Equipment List

  • LED Screen
  • Camera Jib
    • RED Komodo-X
    • Canon COMPACT-SERVO 18-80mm T4.4 EF Zoom Lens
    • stYpe Redspy Optical Camera Tracker
    • Miller Fluid Head
    • Proaim Heavy-Duty Mitchell Base Tripod Legs with Mid-Level & Ground Spreaders, with Portable Tripod Dolly
  • TeraDek CTRL.3 Wireless FIZ Control
  • Lighting Grid & Lights
    • x3 ChromaQ Spaceforce
    • x3 Ikan Stryder Bicolor LED Fresnel
  • IonXE Lighting Console

How can I use this facility?

Range of Use

Previously, this space contained a chromakey-able green screen curtain. As long as you were taking a class or were associated with a faculty-backed project/capstone that granted you booking access to the Studio, you were able to reserve Ansin 309 as a small green-screened production space.

However, as we now have an LED wall, lighting grid, a tracked camera rig, and dedicated backend server room, the supported production capabilities of Ansin 309 has expanded. Depending on the kind of project/use case you are looking for from the space, this will define the initial range of access and inform any additional training/orientation to ensure knowledgeable and safe use of the equipment. Here are a couple of guiding questions that can help clarify what level of support and training your request would need:

  1. Are you looking to simply film in front of a static or pre-recorded/pre-rendered background?
  2. Are you looking to film in front of a real-time rendered 3D virtual environment made in a game engine such as Unreal Engine?
  3. Does your project require a tracked camera?
  4. Will your project have live-composited virtual elements?
  5. Will your project also utilize physical set pieces?

If you have access to Ansin 309 through a class, faculty-approved project, or approved extracurricular use and only need the LED screen as a static background or backlit greenscreen, you may not necessarily need as much training/orientation though you will need to create and provide the media or project serving as the displayed backdrop on the LED wall. For setup and configuration, you may also need the assistance of an EML staff member or trained faculty.

However, if you will need a real-time rendered background, together with camera-tracking functionality, then further operational and safety training will be needed. In order to have access to the XR Studio as a virtual production space (in this case), you will need to have taken a Virtual Production class and have gone through the relevant orientation in the EML on how to safely operate the facility.

Access & Authorization

Primarily, general access to the Ansin 309 is prioritized for courses within the Emerging Media area. The XR Studio's Virtual Production-specific capabilities are primarily prioritized for the Virtual Production courses (VM420 & VM604 held within the EML). Here are questions to consider when regarding access:

  1. Are you currently enrolled in a class using the XR Studio and/or for Virtual Production?
  2. Have you taken a class, having gained the necessary knowledge regarding Virtual Production and how to operate the XR Studio facility and resources?
  3. Have you gone through the orientation on how to safely operate the XR Studio?
  4. With the necessary training and authorization, are you currently associated with either a faculty-approved project/thesis or extracurricular/college-associated organization (the latter's requests are taken on a request-by-request basis)?

Knowing & Operating the Space

Below is a list of different linked guides, workflows, and information relating to the XR Studio space.

  1. Knowing the terms and the facility
  2. How to bring in Image & Video media
  3. Creating a 2.5D Parallax-based scene
  4. Authoring a Real-Time Rendered virtual environment
  5. Taking advantage of Live-Compositing
  6. Filming with an Inner & Outer Frustum
  7. Operating the Camera Jib (TBD)
  8. Recording and Output
  9. Operating the Ion XE Lighting Board (TBD)
  10. Outputting an external source to the LED Wall (TBD)
  11. Operating your Unreal Engine virtual set in Real-Time (TBD)

Reservation & Access

  1. For Production Requests (productions/projects not associated with the Virtual Production course), please fill out the EML XR Studio intake form on TechMedia's Zendesk for the EML XR Studio. Requests should be filled out at least 2-3 weeks ahead of your desired production/filming date.
  2. You will also need to fill out the form on the VMA Production Portal for the project.
  3. You will be followed up by the EML Manager by email. You both will schedule a 45 minute meeting to go over your proposed production project in detail. This is to gauge the needed support, testing needs, and preparations for the project, as well as to confirm the production's safety.
  4. Assuming all is well with the production in terms of curricular approval and no safety concerns, your requested & held production time (when/if available) will be set & confirmed.
  5. Your production's crew must have passed through/participated in the EML's XR safety orientation workshop by the end of the week before your scheduled production in the XR Studio, or they cannot partake during the allotted filming time.
  6. Additionally, during the manager meeting or follow-up, you will have your QC time scheduled, typically the week before your scheduled production. During this period, it is highly recommended that you confirm your intended lighting setup (grid and any floor standing), your Unreal Engine scene configuration, your shot list (and any needed adjustments to the Studio configuration) and checking how it all looks within the XR Studio & camera.

Volumetric Capturing

Furthermore, the XR Studio can provide a space to perform volumetric captures using DepthKit Studio. You will need the depthkit Capture computer, the Azure Kinect ToF Sensors, the Azure Kinect Sync Kit, and the Aruco Calibration boards. For production related setup, you will also need six electric stingers, five C-Stands, five Gobo/Grip heads, five Cardellini Clamps, and Gaffer's tape.

The computer, calibration boards, and Gaffer's tape are available at the EML; however, the other items are vended/provided by the EDC. As such, this request may require coordination in terms of resource availability and reservation. In the event, you are looking to setup for volumetric video capturing at the Tufte TV Studio, please include that as part of your request and CC

If you are looking to reserve the Studio for volumetric video capturing, please reach out to postproduction@emerson.edu, and the necessary parties will be looped in. Don't hesitate to reach out for any questions. 

Safety Policies

Please refer to the following resources in regards to Emerson's production safety policies:

  1. VMA Filming Policies
  2. Student Production Safety
  3. Safety - TV Studios

The following are the basic safety policies and guidelines within the EML's XR Studio.

  1. Active filming/work areas and pathways through it are to be kept clear of materials, equipment, cables, trash, and personal belongings.
  2. Open flames, toxic substances or dangerous materials are not permitted.
  3. No smoke/fog/haze, open flames, animals or weapons.
  4. No smoking/vaping.
  5. A basic understanding of electrical power (e.g. breakers, lights, electrical etc.) and the dangers of equipment misuse is required.
  6. Exercise caution when using the step ladder for the adjustment of lights and/or remounting items on the grid. Maintain three points of contact. Have another person help and keep watch (buddy system) while doing so.
  7. Safety cables MUST be used to secure lights and mounting peripherals hung from the grid. Barn doors must also be attached to the light or grid with a safety.
  8. Knowledge of the safe and proper use of the grid is required.
  9. Operate the camera jib in pairs, especially when disengaging the boom/lift lock. One person is holding/controlling the weight and the other handling the camera.
  10. It is also recommended to have someone handling/wrangling the XR camera's cable while moving/operating the jib to prevent tripping crew/actors or the jib from running over the cable.
  11. Any set pieces must be securely attached and braced with jacks and sandbags. Please ensure there is sufficient space for actors/crew to navigate, as well as from the equipment/screen in the room.
  12. Set pieces and stands (whether lights, sensors, etc.) must be securely braced with sandbags.
  13. Be sure to practice good cable management, and keep them bundled, gaffed down and out of the way for those navigating the Studio/Lab space.
  14. Be careful when moving near the LED Screen. Keep your distance when possible.
  15. If you are operating the Studio area for Virtual Reality, you must wear the controllers' wrist straps.
  16. Do not throw objects for shots without planned and pre-approved choreography. There needs to be explicit approval by the EML manager. Thrown/tossed objects must be done away from the LED screen and any/all equipment contained in the space, with controlled & intentional force. Keep in mind other peoples' safety as well as the integrity of the facility and nearby equipment. You will be held responsible for negligent behavior.
  17. When moving through the space, ensure you have sufficient lights to navigate around safely.
  18. Please do not drag sets and risers across the rubber floor. Safely lift and move these in pairs, and again, ensure they are secured and are not in danger of falling over and potentially hurting someone else or damaging the facility.
  19. Please be mindful of your distance to the LED wall when placing/securing sets as well as blocking your actors, especially if you have more active choreography. Please leave a distance buffer between yourself and the wall of about 3 to 3.5ft. For intense movement, ensure your costume and accessories are secured as to not have them flying off into or getting caught onto someone/something else in the Studio.
  20. If you don’t know – ASK. You'll find assistants available to help in the EML Annex (Ansin 314) during our opening hours.

Sources and Further Information

  1.  Safety
  2. Epic Games: The Virtual Production Guide
Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a ticket

Articles in this section

See more