# data[].attributes.attachment_link.description
What is Design Thinking? Design thinking is a non-linear, iterative process that teams use to understand users, challenge assumptions, redefine problems and create innovative solutions...

# data[].attributes.attachment_link.title
Free Gantt Chart Template - StudioBinder

# data[].attributes.headline
Virtual Production Techniques - The Interactive & Immersive HQ

# data[].attributes.subject
Virtual Production Techniques - The Interactive & Immersive HQ

# data[].attributes.attachment_link.readable_text
We recently discussed the rise of Virtual Production technology as one of the most promising fields in terms of audiovisual creation. Without a doubt it's been a game-changer, and because it's so deeply technology-driven we could dare to say that its state of the art is ever evolving. So today, in order to keep up with its evolution we will be having a look at the main types of Virtual Production setup, tools, and methods being implemented in the industry.

The Core Technology

So, what is Virtual Production? Virtual Production is the result of practices that originated in the gaming and virtual reality fields. This means that software such as Notch, Unreal Engine and TouchDesigner, are used to deploy techniques we've been using in video games for decades now, just in an updated, high-end, incredibly mathematical manner.

The applications of these systems and techniques have made a significant impact in most of the range of content we consume nowadays. The use of Virtual Productions has permeated the fields of interactive Film, TV, Live Events and Broadcasting, Video games, Architecture and Engineering, just to name a few.

Now, let's have a look at the different technological configurations commonly used in the Virtual Production pipeline.

LED Volumes

This is perhaps the most common approach to the Virtual Production process and design nowadays. It is characterized by the use of a large, high-definition LED screen that replaces a scene's background.

By placing the LED volume in a large, comfortable and safe space, studios are now able to create hybrid scenes. Actors and props are placed in front of the LED screen and, through camera tracking, are captured in a mixed reality environment.

In such a creative space filmmakers can achieve shots that would've been almost impossible to capture in location shooting, and certainly at a greatly reduced price.

Previs / Techvis / Postvis

These are the three stages of visualization that are transited through during a virtual production project.

Previs

Refers to the pre-visualization process where artists begin to develop 3D storyboards based on scripts and ideas that have been provided by the director and writing team.

This is a huge advantage since artists are able to start designing a scene way before it is actually shot with actors and props, which in turn allows for deeper idea exploration. And, even though a large amount of the content that is created doesn't make the final cut, it is through this process of pre-visualization that directors and artists refine the development of complex and challenging scenes.

Techvis

Once a scene has been developed in previs, and shortly before the scene is shot with talent and props, there is a joint action between the virtual art department and the real-world art department. This is the stage at which the integration between the physical world and digital begins.

Since artists and directors already have information about the scene, it is only a matter of fine-tuning both digital and physical components to accomplish a unified scene in interactive movies.

Postvis

At this stage the captured footage is processed and adjusted by the postvis team. This can range from light to heavy intervention depending on the captured footage, but since Virtual Production can be such an accurate form of creation, the process of postvis is not as dramatic as traditional post-production is. Think about it, all the information about the scene is readily available, so in case there's a need to introduce further props, CGI characters or adjust mood and lighting settings, it can be executed effortlessly in real time and then captured by the same camera capturing the actors.

Green Screen in Virtual Environments

Even though it was the use of LED volumes that displaced the green screen, there is still space for its implementation in Virtual Production. It, mainly, serves the purpose of integrating "actors" in fully virtual and immersive settings.

For example, let's say there is a virtual conference with speakers in different parts of the world. A virtual conference room is created, and the actors are remotely integrated into the scene through the use of a green screen and virtual reality techniques.

This is a technique that allows implementation and access to public services where a host, agent, or human resource is needed such as virtual art galleries, virtual doctor's appointments etc. or simply for the realization of global live virtual events. There are many new technologies that might further displace the green screen such as AI/ML based background subtraction and GPU accelerator background subtraction found in Nvidia RTX pipelines.

XR Virtual Production

Extended Reality is a form of Virtual Production workflow that emphasizes on the expanding of sets and virtual studios. The most common arrangements for this expansion are LED "caves" and the use of back plate, camera plate, and front plates. This is a technique used to give further layering to a scene, dividing it into several stages that are composited in order to create a unified scene.

The back plate refers to the content placed behind actors and props, the camera plate is the area that contains talent, and the front plate provides an area in front of the talent to further develop our scene.

Another form of expansion is the use of LED volumes in select locations for hybrid reality performances and broadcasts. In this case all possibilities are taken into account: the digital content that will be incorporated in the LED projection, the setting where the performance is taking place, and VFX added on top of the scene.

Here is an incredible example by Volvox Studios and Dubfire.

Wrap Up

The world of Virtual Production is a large and varied one, and is taking over the interactive video workflow. Many technologies work in synergy to develop a highly sophisticated product, and it takes some time to get familiar with all the practices involved in this creative process, like user interactivity. I hope today's information has made the topic more accessible to you TouchDesigner pros, and encourages you to research the areas you're more interested in! Until next time!

# data[].attributes.attachment_link.title
Virtual Production Techniques - The Interactive & Immersive HQ

# data[].attributes.attachment_link.description
In this post we will take a look at the different Virtual Production techniques being used in the industry today.

# data[].attributes.attachment_link.description
Explore SunoAI.ai for the revolutionary Suno AI Music Generator V3. Create unique AI MP3 songs instantly, free to use. Download and enjoy innovative music now!

# data[].attributes.attachment_link.title
Luma Dream Machine: New Freedoms of Imagination | Luma AI

# data[].attributes.attachment_link.description
Ideate, visualize, create videos, and share your dreams with the world, using our most powerful image and video AI models.

# data[].attributes.body
walter Yno - Luma - music generated with Suno

# data[].attributes.body
Nancy Ibsen animated with #LumaDreamMachine

# data[].attributes.attachment_link.title
Puppet Threatre, animated with #LumaDreamMachine | By NancyFacebook

# data[].attributes.attachment_link.description
Puppet Threatre, animated with #LumaDreamMachine

# data[].attributes.body
animated with #LumaDreamMachine

# data[].attributes.attachment_link.title
Trying to Get a Grip, animated with #LumaDreamMachine | By NancyFacebook

# data[].attributes.attachment_link.description
Trying to Get a Grip, animated with #LumaDreamMachine

# data[].attributes.body
"I was waiting to bring my “Hybrid Characters” to life when  Runways new Image-2-video model was announced. I am pretty speechless about what is going to be possible now. Images were created in Midjourney and retouched in Photoshop."

# data[].attributes.attachment_link.title
25K views · 4.6K reactions | This AI makes entire videos for you.

InVideo is an AI tool that’s an absolute game-changer for content creators. @invideo.io 

Just type in the video... | By FILM CRUXFacebook

# data[].attributes.attachment_link.description
This AI makes entire videos for you.

InVideo is an AI tool that’s an absolute game-changer for content creators. @invideo.io 

Just type in the video...

# data[].attributes.attachment_link.title
3.1M views · 318 reactions | Create your FREE AI video! | L&D Teams - This👇 AI video tool could solve your biggest bottleneck when it comes to producing high quality learning content. 

It’s rated ⭐⭐⭐⭐⭐ and you... | By SynthesiaFacebook

# data[].attributes.attachment_link.description
L&D Teams - This👇 AI video tool could solve your biggest bottleneck when it comes to producing high quality learning content. 

It’s rated ⭐⭐⭐⭐⭐ and you...

# data[].attributes.attachment_link.title
New Smart Glasses Tell You What to Say on Dates Using GPT-4

# data[].attributes.attachment_link.description
A team of Stanford students have come up with a pair of smart glasses that can display the output of OpenAI’s GPT-4 chatbot.

# data[].attributes.attachment_link.title
The Videogame Industry Does Not Exist: Why We Should Think Beyond Commercial Game Production

# data[].attributes.attachment_link.description
The precarious reality of videogame production beyond the corporate blockbuster studios of North America.The videogame industry, we’re invariably told, is

# data[].attributes.attachment_link.title
MARIA MAVROPOULOU — A family photo album made with the use of Artificial Intelligence

# data[].attributes.attachment_link.description
In this project titled Imagined Images AI technology is used to create images reminiscent of childhood photo albums but lacking a direct tie to reality. Using DALLE-2, I visualized moments from my family’s history of displacement and loss, including imagined and unphotographed events. This project e

# data[].attributes.headline
A short film entitled "Air Head," created by the artists Shy Kids using the Sora AI 2023

# data[].attributes.subject
A short film entitled "Air Head," created by the artists Shy Kids using the Sora AI 2023

# data[].attributes.attachment_link.title
A short film entitled "Air Head," created by the artists Shy Kids using the Sora AI. | By Matthew | Facebook

# data[].attributes.attachment_link.description
A short film entitled "Air Head," created by the artists Shy Kids using the Sora AI.

# data[].attributes.attachment_link.title
Marvel Director Expects Fully AI-Generated Movies Within Two Years

# data[].attributes.attachment_link.description
Joe Russo, a director who’s helmed some of Marvel’s biggest movies, thinks it’s only a matter of time before AIs can make legit films.

# data[].attributes.attachment_link.title
Mind-Blowing Video Editing App Can Replace Actors With CGI With a Simple Drag and Drop

# data[].attributes.attachment_link.description
The AI-powered Wonder Studio allows users to automatically replace real actors with convincing CGI characters — with a simple drag and drop.

# data[].attributes.attachment_link.title
Live immersive experience only possible with ‘deep pockets’ of creators, report reveals - University of Birmingham

# data[].attributes.attachment_link.description
More than half of creatives who put on live/location-based immersive experiences are having to self-fund performances, a new report finds.

# data[].attributes.body
"Immersology studies the emerging genre of immersive theatre from the creator’s point of view. It offers theories, structures, design struggles, practicals, and other meta-level musings. Immersive theatre is a distinct genre of performative storytelling, as distinct as a play or a musical, and Immersology aims to inspire  creativity in this exciting new frontier."

# data[].attributes.attachment_link.readable_text
Beau Lotto's research into perception has shown that we don't see the real world-just our version of it. It's a version we've evolved to perceive, where shadows, shapes, and even how we understand time are meanings we ascribe to what we're seeing. Our senses are telling us stories about the world-and we can control those stories to change our perceptions and ourselves. Digital technology that's purely virtual can't totally engage with our perceptions, but when it augments the physical reality we evolved in, that's when we can truly occupy the space between the real world and what we want it to be.

# data[].attributes.attachment_link.title
Beau Lotto: Understanding Perception: How We Experience the Meaning We Create

# data[].attributes.attachment_link.description
Beau Lotto's research into perception has shown that we don't see the real world-just our version of it. It's a version we've evolved to perceive, where shadows, shapes, and even how we understand time are meanings we ascribe to what we're seeing.

# data[].attributes.attachment_link.title
Transforming Midjourney Ai Art into Video Is AMAZING #midjourney #runway #imagetovideo

# data[].attributes.attachment_link.title
AI Will Change Filmmaking (and how to be ready)

# data[].attributes.headline
Karen Palmer - The Future of Immersive Storytelling

# data[].attributes.subject
Karen Palmer - The Future of Immersive Storytelling

# data[].attributes.attachment_link.title
Karen Palmer – The Future of Immersive Filmmaking (FoST 2017)

# data[].attributes.attachment_link.title
The Future of Storytelling | A Modern Moby Dick

# data[].attributes.attachment_link.title
2022 – Digital Dozen: Breakthroughs in Storytelling awards

# data[].attributes.attachment_link.title
Create Cinematic AI Videos with Runway Gen-2

# data[].attributes.attachment_link.title
Why 'The Mandalorian' Uses Virtual Sets Over Green Screen | Movies Insider

# data[].attributes.attachment_link.readable_text
This database* is an ongoing project to aggregate tools and resources for artists, designers, engineers, curators & researchers interested in incorporating machine learning (ML) and other forms of artificial intelligence (AI) into their practice.

*The collection of materials presented aren't comprehensive-it is a growing collection of research collected & commissioned by the Creative AI Lab.

Tools are compiled by the Lab according to their potential to bring new capabilities to artistic workflow. They can be generative (producing images or text from data) or assist along the way in the creative process, including in R&D or simulation building. Tools might be core to the production of the work itself, or play a smaller assistive role. Resources help to imagine and critically conceptualise future AI systems, ways of working and deployment contexts.

# data[].attributes.attachment_link.description
This database* is an ongoing project to aggregate tools and resources for artists, designers, engineers, curators & researchers interested in incorporating machine learning (ML) and other forms of artificial intelligence (AI) into their practice. *The collection of materials presented aren't comprehensive-it is a growing collection of research collected & commissioned by the Creative AI Lab.

# data[].attributes.body
https://www.youtube.com/watch?v=VskCK0f-FKg&t=140s

Epic Games invited IGN's Ben and Jeffrey to take a tour of their cutting-edge virtual set they call The Volume, the same technology used to film The Mandalorian. Check it out as we get a thorough tour of this incredible tech from Epic Games ICVFX Stage Operator Mike Sill.

# data[].attributes.attachment_link.title
The Future of Cinema: Epic Games Gave Us an In-Depth Tour of The Volume (Their Virtual Set Tech)

# data[].attributes.attachment_link.title
2021 – Digital Dozen: Breakthroughs in Storytelling awards