by Dan Neafus, IMERSA co-founder; Manager, Gates Planetarium
Dan Neafus and his “Language of Fulldome” live presentation/demo have been in demand for several years at conferences and film festivals. Neafus points out that the unique, immersive properties of the medium and their effect on the viewer call for a unique approach to storytelling that departs in many instances from traditional filmmaking techniques. The presentations have grown into a full-fledged written treatise on the subject, of which this is an excerpt. Dan cites as one of his foremost inspirations in developing these concepts filmmaker Prof. Ben Shedd of the School of Art, Design and Media at Nanyang Technological University in Singapore, particularly Shedd’s “Exploding the Frame” research.
Modern storytellers and technicians are inventing a new language for immersive cinema which may be expressed in many ways. This evolving experiential language is a synthesis of jargon and techniques from many disciplines, each contributing its own idiosyncrasies to our conversations.
Within immersive cinema we must recognize that as you move the camera, you are moving the audience, physically and emotionally. The camera is the viewer and our virtual camera represents not just the audience perspective, it is the viewer’s reality.
Language of the sphere
An immersive screen may be thought of as a bubble ship, enclosing an audience. When describing the attributes of a shot we are actually describing what is happening to the audience while traveling within this bubble, consider that the audience is the camera.
Linguistic challenges persist as we begin to define techniques for choreographing immersive cinema. The term shooting is ambiguous because we are no longer aiming and shooting at things. The recording or rendering may be initiated by simply clicking a mouse button. Our cameras are often virtual, or it may be some extremely wide angle, omnicamera designed to acquire every sight and sound in a spherical scene, again the recording may be triggered remotely with a finger touch.
We can redefine our language of shots by modifying some conventional shooting descriptions. Currently accepted camera lingo uses the perimeter of the rectangular frame as a reference and describes the apparent movement of subjects within the viewfinder frame. Scenes are composed in relation to this frame, by moving the camera: vertically, horizontally, far, close, or by having the subject(s) themselves move, or by manipulating the optical mechanical lens focus and magnification.
To define a fulldome sequence, a director needs to describe audience motion, while disregarding the viewfinder frame. They must use techniques to illustrate exactly what the audience sees around them, and how they are moving in relation to the subjects. These audience motions are similar to conventional camera moves rather than lens movement, and require a more appropriate, audience-centric terminology to describe them.
When an audience moves away from a subject more of the surroundings are revealed around it creating a wider field of view. This is not done by optical means, as is typical in zoom lens shot. It is done exclusively by moving the audience viewpoint from one location to another. Thus a wide shot is a viewpoint from very far away from the subject, taking in most of the scenery around the subject. A long shot or establishing shot is a vantage point that is far from the subject. A medium shot is closer to the subject and a close up is an audience view near the subject. A tight shot is acquired when the audience feels very close to the subject.
Many sequences from immersive cinema need to be experienced to be understood. Real time data navigation software has simplified the choreography of complex scenes by allowing a piloting director to use a flight control device to rehearse a flight path sequence through a model and then save out representative frames as a storyboard, illustrating important moments within the sequence.
Using this real time technique, a director can actually rehearse each sequence in person. When rendered these unique experiences become part of a catalogue of experiential precedents that all film makers can reference. Audiences will be able to experience these moving scenes in person and become familiarized with these new techniques, adding to their visual and experiential literacy.
The majority of shooting conventions are useless when creating complex immersive scenes where an audience moves among other moving objects. These audience motions help to tell the story and often create interaction with the scene’s content. For example our audience feels like they are shrinking as they pass through the eye of a needle during the fulldome film NANOCAM by Roberto Girón.
In the film ALL WE ARE by Carter Emmart, illustrating an adaptation of the Ray and Charles Eames movie POWERS OF TEN, the audience slowly spirals down toward objects on a tabletop. They feel like they are shrinking, as objects appear larger and larger in the foreground. Large objects loom in the background while emphasizing ever smaller objects appearing one by one in the foreground.
Immersive cinema is experiential cinema, engaging the audience in a shared voyage.
Discovering places otherwise impossible to visit, the audience transcends physical limitations of time & distance, shrinking down to witness tiny details of atoms, or perhaps travelling back in time to explore our primordial origins. Immersive cinema is a shared experiential voyage within a common sphere of perception.
Science visualization artist Robert Patterson endeavors to disseminate his team’s earth and space science by flying audiences through the data assembled by his team. This type of reality based immersion helps scientists to create accurate virtual models directly from their own data. Once visualized, a researcher can navigate and share their model of reality with colleagues or the public.
Scientific visualization is utilized in many disciplines of research, from archeology to astrophysics. Virtual voyages take on special meaning when exploring scientific data sets acquired through cameras, telescopes, microscopes or satellites. Features that are collected digitally may remain unseen in their raw digital format, until they are rendered into reality through scientific visualization and virtual immersion. When the dynamics of time and motion are added into the equation, participants can truly experience being within a phenomenon.
Language of the edit
Today’s editing language is quite sophisticated and its comprehension is common among the modern movie audience. These conventional edits work well for small screens but may be quite disorienting when used in the immersive environment. Some fulldome directors choose instead to choreograph an uninterrupted camera path, arguing that the best edit is no observable transition at all.
To avoid confusing an audience and help them to follow the movement of the story, some directors try to design uninterrupted sequences into long continuous shots throughout the story. This immersive editing technique guides an audience effortlessly throughout a film. Any unavoidable transitions between scenes are carefully planned for the giant screen, resulting in a seamless voyage throughout the entire story.
Another traditional film editing technique sequences reverse angle shots by quickly cutting between several points of view. A preferred approach for immersive cinema takes a completely different approach by slowly orbiting the camera around the subject, providing the audience with views from different sides of the action. This is much less confusing to the viewer than multiple hard cuts from opposing sides.
The fulldome film WE ARE ASTRONOMERS by Max Crow effectively uses this orbiting technique and a corresponding subsonic sound effect, to reveal complex phenomenon as the audience orbits two impacting particles in the Large Hadron Collider. This orbiting technique preserves context throughout the scene and avoids confusing the audience.
Depth of field and racking focus techniques work well for moving pictures and have been adapted for immersive cinema to emphasize a subject through manipulation of focus and detail. Reveal shots also work well in immersive cinema. Reveals may have the subject appear out of darkness or appear larger and larger as they approach from obscurity. It is also quite effective to reveal subjects by having them move into view from the bottom edge of the screen. Peter Popp’s film REALM OF LIGHT using dark, rocky asteroids to frame the next scene and then drift out of view to fully expose a giant red star looming in the background.
As a common language for immersive cinema is translated and adopted, we should become more proficient in communications with our peers and will give our audiences more meaningful immersive experiences.
Fulldome theaters are not only hemispheres of experience, they are spheres of influence. Audiences and producers are becoming more and more informed, learning what can be done, and what to expect from an immersive film. Yet immersive cinema remains a naïve format offering unprecedented access and creative opportunities to producers.
Muriel Rukeyser’s observation that “the universe is made of stories not stars,” reminds us of the timeless importance of our stories, inspiring us to become more fluent in our language of immersive storytelling and to connect with our audiences by speaking to their hearts. Immersive cinema offers unprecedented access and creative opportunities to producers. • • •
Comments Off on Kraftwerk Living Technologies introduces LED solution for dome theaters
Comments Off on IMERSA issues call for fulldome and 3D audio submissions for 2019 Summit
Comments Off on Michael Daut: Building a bigger Mousetrappe
Comments Off on Legendary Filmmaker and Attraction Designer Douglas Trumbull to Receive Lifetime Achievement Award from IMERSA
Sep 24, 2020 Comments Off on InPark exclusive: Crayola’s new interactive exhibit is designed to channel children’s innate creativity and expands the company’s LBE presence
Sep 24, 2020 Comments Off on WishTrip integrates game builder into its tourism experience management platform
Sep 23, 2020 Comments Off on Christie now offering Mirage SST laser projector with 50,000 lumen light source
Sep 23, 2020 Comments Off on Analog Way’s Aquilon C processor drives 7.8 million pixel LED display in downtown Manhattan
Sep 24, 2020 Comments Off on InPark exclusive: Crayola’s new interactive exhibit is designed to channel children’s innate creativity and expands the company’s LBE presenceThis tour represents the next step in a portfolio of LBEs...
Sep 02, 2020 Comments Off on Smaller attractions: Following the leaderHow smaller attractions stay competitive and innovative...
Aug 19, 2020 Comments Off on Nathan Jones: Continuing a journey of amazing attractionsFollowing a long track record at both WhiteWater and...
Jun 30, 2020 Comments Off on Right place, write timeHollywood screenwriter Bennett Yellin authors a new future...
May 18, 2020 Comments Off on Eleventh Hour: The rise of consultants since COVID-19 affords a vision of leadership for the Location Based and Themed Entertainment Industry.To help companies respond to industry-specific challenges,...
May 05, 2020 Comments Off on Inside the time machineCreative Principals’ Geoff Thatcher says now is the...
Apr 22, 2020 Comments Off on InPark exclusive: International participants in Dubai Expo 2020 share thoughts on the likely one-year postponement and the status of their pavilionsLeaders of several national pavilions being developed for...
Apr 03, 2020 Comments Off on Bingo Tso, ACE International, on the effects of COVID-19 pandemic on Asian companies and the attractions marketBingo Tso of ACE International shares his perspective from...
Mar 17, 2020 Comments Off on COVID-19: Reassurances from Beijing and Kelly Ryner (Thinkwell)"As for business here in China, there is a lot of positive...
Dec 25, 2019 Comments Off on California’s Great America WinterFest: Transforming a theme park into a holiday wonderland.With millions of lights and thousands of decorations, the...
Nov 16, 2019 Comments Off on #80 – IAAPA 2019Table of contents
Nov 15, 2019 Comments Off on Meet Amanda ThompsonIAAPA’s incoming chair has deep roots in the attractions...
Nov 15, 2019 Comments Off on TEA 2020A chat with Michael Blau - incoming TEA International Board...
Nov 14, 2019 Comments Off on IAAPA 2019 Chair David Rosenberg: The aqua-manRosenberg serves as the 2019 Chair of the IAAPA Board of...
Nov 14, 2019 Comments Off on CircusTrix CEO Fernando Eiroa: Leaps and boundsInPark spoke with Eiroa about the unique business of...
Nov 09, 2019 Comments Off on InPark exclusive: Interviews with Jeremy Railton and Scott Ault on the launch of their new company, Railton Entertainment Design (RED)Themed entertainment design veterans Jeremy Railton and...
Oct 22, 2019 Comments Off on ISE 2020The annual Integrated Systems Europe (ISE) trade show for...
Oct 21, 2019 Comments Off on IAAPA: “Wear comfortable shoes!”"If this is your first Expo, attend the First Time...
Sep 11, 2019 Comments Off on Netflix and thrill: Greg Lombardo joins the content streaming powerhouse as Head of ExperiencesLombardo brings with him more than a decade experience in...
Sep 10, 2019 Comments Off on Transitions: Leaps and boundsIndustry professionals are making moves and creating waves
Sep 09, 2019 Comments Off on Exploring IAAPA EuropeMeet recent additions to IAAPA’s European team
Aug 08, 2019 Comments Off on IPM Interview: Jennifer Lee Hackett, Sinking Ship EntertainmentGiant screen veteran Jennifer Lee Hackett has joined...
Jun 28, 2019 Comments Off on John Miceli and the new DE-ŹYN StudiosThroughout his career, John Miceli has worked in feature...
Jun 26, 2019 Comments Off on Meet Lionsgate Entertainment World’s new general manager: Selena MagillMeet the new GM of Lionsgate Entertainment World, scheduled...
May 08, 2019 Comments Off on ECA2: All eyes on LanzhouECA2's latest spectacle, a permanent installation in a...
Sep 07, 2020 Comments Off on #82 – Solving problems with innovation
Sep 07, 2020 Comments Off on The InPark Magazine editors: Meet the press
Sep 07, 2020 Comments Off on Alterface: Popcorn Revenge results
Sep 07, 2020 Comments Off on Christie: Ultimate contrast
Sep 07, 2020 Comments Off on The Land of Legends meets Masha and the Bear
Sep 03, 2020 Comments Off on Diving into the TEA/ AECOM Theme Index
Sep 02, 2020 Comments Off on Smaller attractions: Following the leader
Aug 15, 2020 Comments Off on Funding, revenue, reopening and saving the animals: Museums struggle in COVID times
Aug 05, 2020 Comments Off on Three industry leaders talk about the TEA Thea Awards: Nancy Seruto, Susan Bonds, and Wendy Heimann-Nunes
Aug 03, 2020 Comments Off on Going virtual: TEA honors Thea Award recipients with Digital Case Studies event
Jun 30, 2020 Comments Off on Right place, write time