Role: Unreal Engine Live Design
Unreal Based Performative Interactive Design. Gesture Controlled Motion Capture and DMX design.
Project Overview
For the launch of Pacific Biosciences' (PacBio) new product at the American Society of Human Genetics (ASHG) conference, I developed a groundbreaking interactive presentation system using Unreal Engine. This award-winning show, held at the Novo Theater in Downtown Los Angeles, captivated a massive live audience with its innovative approach to product demonstration.
Technical Highlights
Gesture-Controlled Presentation: Created a custom Unreal Engine blueprint system that allowed the CEO to navigate through product slides using hand gestures, reminiscent of the technology in "Minority Report."
DMX Integration: Implemented a DMX-controlled Unreal Engine system for real-time manipulation of environments and visual effects.
Interactive 3D Environments: Developed a series of morphing worlds and interactive environments, including a vast, explorable universe.
Key Contributions
Gesture Control System
Designed and implemented a cutting-edge gesture recognition system using Unreal Engine blueprints.
Integrated motion capture technology to accurately track the presenter's hand movements.
Created intuitive gesture mappings for slide navigation, zoom functions, and interactive element manipulation.
DMX-Controlled Unreal Engine Environments
Developed a robust DMX control system that allowed for:
Real-time environment transitions synchronized with the presentation flow.
Dynamic lighting adjustments to highlight key product features.
Triggered visual effects to emphasize important points in the presentation.
Immersive Visual Effects
3D Universe Showcase:
Created a vast, explorable 3D universe that served as an overarching metaphor for the product's capabilities.
Implemented interactive elements within the universe to represent different aspects of the product.
Morphing Worlds:
Designed a series of transforming environments that visually represented the product's various applications and benefits.
Developed smooth transition effects between different "worlds" to maintain audience engagement.
Product Visualization:
Created detailed, scientifically accurate 3D models of the PacBio product and its components.
Implemented interactive exploded views and cutaways to showcase the product's internal workings.
Technical Deep Dive
Gesture Control Implementation
Utilized Unreal Engine's VR framework as a base for the gesture recognition system.
Developed custom blueprints to interpret and translate hand movements into presentation controls.
Implemented a machine learning model to improve gesture recognition accuracy and reduce false positives.
Real-Time Rendering Optimization
Balanced high-fidelity visuals with the need for smooth, real-time performance in a live presentation setting.
Implemented dynamic LOD (Level of Detail) systems for complex 3D models and environments.
Optimized lighting and post-processing effects for maximum visual impact with minimal performance overhead.
DMX Integration
Created a custom DMX interface within Unreal Engine to allow for precise control of virtual elements.
Developed a cue system that synchronized virtual environment changes with lighting and audio cues in the physical space.
Challenges and Solutions
Presenter Training: Worked closely with the CEO to ensure comfort and proficiency with the gesture control system, including developing an intuitive training program.
Fail-Safe Mechanisms: Implemented redundant control systems and quick recovery options to mitigate any potential technical issues during the live presentation.
Complex Data Visualization: Developed innovative ways to represent complex scientific data in visually appealing and easily understandable formats.
Impact and Recognition
The presentation was met with overwhelming positive reception, setting a new standard for product launches in the medical device industry.
Received an award for innovative use of technology in corporate presentations.
Significantly enhanced audience understanding and engagement with PacBio's new product, contributing to the launch's success.
This project showcases the power of Unreal Engine in creating immersive, interactive presentations for complex scientific products. By blending cutting-edge technology with intuitive design, we were able to transform a traditional product launch into an unforgettable experience. The success of this project demonstrates my ability to innovate at the intersection of technology and communication, delivering solutions that not only impress audiences but also effectively convey complex information in engaging ways.