Home
AV
Video
Software
Real-Time PTZ Camera Tracking for Live AR/VR/XR Video Production

Real-Time PTZ Camera Tracking for Live AR/VR/XR Video Production

Panasonic PTZ cameras feature the FreeD protocol, allowing Live Augmented Reality, Virtual Reality & Extended Reality video production.

ptz_cameras_for_virtual_video_productions_with_ar_vr_tracking_and_ai_auto_tracking_software_0

AR / VR Camera Positioning Data

To be able to incorporate realistic VR (virtual reality) or AR (augmented reality) studio sets in your live productions, accurate camera positioning data is imperative. The AW-UE160, AW-UE150, AW-UE100 and AW-UE80 PTZ cameras feature the FreeD protocol, which provides you with the option to output Pan / Tilt / Zoom / Iris information via Serial (RS 422) and IP (UDP) directly from the camera to your tracking system. The FreeD protocol is supported by most popular virtual set systems, including solutions such as Brainstorm, Ross UX XPERIENCE, Vizrt Viz Virtual Studio, and Zero Density.

About the FreeD Protocol

FreeD is a protocol that sends camera positioning data directly from the camera to a virtual reality production system. It enables productions to incorporate realistic virtual studio sets and elements into their live video workflow without the need for additional sensors or encoders.

aw-ue150_virtual_studio_ar_vr_camera_positioning_tracking_for_augmented_reality_live_production-011

AW-UE150 4K PTZ Camera Spotlight

The AW-UE150 PTZ remote camera is the first robotic camera on the market to provide Position Data Notification (PTZF). It's ability to be used in virtual sets is only one of many features that makes it the ideal choice for your robocam needs. It also features a massive wide-angle of view, 4K / 60p video, versatile video outputs and more. This camera takes remote cameras to an entirely different level of performance.

Learn more

Using Panasonic PTZ Remote Cameras on Virtual Studio Sets

FreeD functionality can be activated directly in the web menu or the on-screen display menu of the PTZ camera. To access this functionality, make sure that you have the latest firmware version of the camera installed.

Get the firmware

Customer Profile: Arque Inc. Creative Studio

Discover how Panasonic PTZ Cameras, compatible with the FreeD protocol, were used to construct an AR system capable of real-time synthesizing of competition information as live video for Japan’s largest Sport Climbing competition, BOULDERING JAPAN CUP 2022.

Customer Profile: Virtual Studio Applications

Thanks to the adoption of the FreeD protocol, the AW-UE150 provides real-time positioning to the Virtual Reality Engine™ from Zero Density. Find out how this combination ensures the creation of a cost effective virtual set at the studio of a major TV station in Belgium.