Here is the FX breakdown of various challenges on the film Frozen 2 made by the team behind
Beyond Snow and Ice
Released in 2013, the first Frozen film utilized significant advancements in snow and ice simulation. Frozen 2 upped the ante in effects at the studio in many ways. “Our challenge was the sheer variety of large epic effects which were drastically varied from sequence to sequence,” notes co-head of effects animation, Marlon West. “We had four elemental characters comprised of actorly and stylized effects: the wind spirit, fire spirit, water spirit and earth spirit. Each one of these elemental characters required an unprecedented amount of cross-departmental collaboration with Layout, Character Animation, Technical Animation and Lighting.”
The wind spirit needed to convey emotions and ideas, while only being made of elements in the surrounding environment. Since the wind spirit primarily resides in the Enchanted Forest, artists needed to enable ground and character interaction with any tree or foliage in the forest.
Meanwhile, the water spirit, called the Nokk, was a horse made completely of water. It had to be visible above and below the ocean surface and also had to change state from water to ice. The fire spirit is a small salamander that ignites huge swathes of the forest with magical fire. Those flames also needed to interact with Elsa’s ice blasts. The earth spirits were large rock giants who moved through the forest, throwing boulders, and creating destruction in their wake. They eventually destroy a dam which starts a flood that threatens to destroy the kingdom of Arendelle. Finally, there was also Elsa’s magic spread throughout the film in various forms.
Walt Disney Animation Studios has an accomplished team responsible for all the necessary effects work. “In order to create the sheer volume of dazzling effects in Frozen 2,” says co-head of effects animation, Dale Mayeda, “Houdini was at the core of our effects pipeline, providing flexibility and strength to handle everything from large scale simulations to delicately art directed magic.”
The Water
One of the most technically challenging sequences in Frozen 2 sees Elsa run across a stormy ocean surface, encountering and at times being bested by, waves that are up to five times her height. This sequence required waves of a certain height and frequency and used a combination of simulation and procedural ocean surfaces.
“To create the large breaking barrel waves, we built a wave tank rig using Houdini FLIP with the equation for third-order Stokes waves driving the simulation,” explains effects supervisor, Erin Ramos. “The wave equations were coded in VEX inside of an HDA which allowed the effects artist to input the desired wavelength and amplitude to generate the vector field that gets used in the simulation.”
“For an added layer of realism,” continues Ramos, “the water was simulated with an air field. A lower density layer of particles was added to the simulation and the FLIP solver was modified to allow water particles that have broken off from the main water surface to behave ballistically rather than swim around in the air field. The velocity field generated by the lower density particles was used to advect particles to create secondary elements such as spindrift and spray.”
The choreography of the ocean waves proved to be such an integral part of the composition of the shot that the base simulations had to be run prior to the shots entering layout and animation. This provided animation with aclose-to-final ground surface for Elsa to run on and react to, making her performance more believable.
Near the climax of the sequence, Elsa creates a giant ice structure in an attempt to cross over a 25 foot breaking wave. “This structure,” details Ramos, “was modeled in Houdini based on designs that match the shape language of Elsa’s magic. In doing so, effects artists were able to better control the fracture and destruction of the structure. Utilizing Houdini to do both the flip simulation and sculpting of the waves, as well as the RBD simulation and the modeling of the ice, allowed us to efficiently integrate all the different elements together.”
The climax of the film also involved water simulations for the moment a dam breaks and unleashes a torrent of water hurtling towards Arendelle. Walt Disney Animation Studios took a multi-solution approach to create this effect, advises water effects lead Scott Townsend.
“For the shots where you see the water crashing through the fjord, we ran a low-res flip simulation which was 2km long and 300m wide through the length of the fjord geometry prior to layout positioning their cameras. That way, the layout artists had a physically correct water simulation to work with for composing their cameras to showcase the most interesting and dangerous parts of the flood. From there, artists ran the requisite up-res workflow which was based on a new medium resolution simulation to add surface detail and layers and layers upon whitewater, mist, and spindrift.”
A different approach was taken for the shots where Elsa and the Nokk are seen riding on top of the flood. The challenge here was that the fluid surface needed to look dangerous while also enabling a ‘clear read’ of the characters. This time, a more art-directable solution was employed, with Ramos noting that artists “sculpted fluid sources that traveled along with our characters which gave our flip simulation a more predictable and controllable result.”
The Mist
As the characters journey to the Enchanted Forest, they encounter a 50-foot thick impenetrable wall of mist. This was created by the FX department as a ‘gauzy’ blanket of mist with a hint of magical spirit, according to effects lead Jesse Erickson. “This presented scale challenges; the wall needed to work efficiently up close and in wide establishing shots. We tried several different looks for the mist but most were a combination of simulation and instancing.”
To create the wall of mist, artists began by converting the landscape to a height field and draping the mist curtain along the landscape using Vellum Cloth. “Since the curtain started as a polygon grid,” says Erickson, “we applied a modified rest length to encourage bunching and folding along the top of the curtain. This was super fast to set up and allowed very quick iterations to get the final shape and fold frequency right. Then we generated a couple of 1000 frame Pyro sims at the origin with heavy disturbance and a directional flow.”
Erickson notes that a handy aspect of the chosen workflow was that each sim had a corresponding bgeo sequence of advected particles that were rendered as a separate sparkle pass. “Because we planned for this instanced packed prim workflow, the VDB and bgeo sequences had the same paths except for the file extension,” he says. “This meant that once our packed volume instances were in place, with frame offsets applied, we could just change the extension of the packed disk primitive file and it would convert the volume caches to particle caches in place.”
Artists also calculated the curvature of the curtain geometry to generate emissive volume in folds and crevices and to create a backdrop for any gaps between the instanced sims. “The turnaround on these shots was mostly on the rendering side so we had ample flexibility to iterate interactively and via flipbook,” discusses Erickson.
Once the team had the wall in good shape for the establishing shots, they could then focus on how it would open. First, the art department provided painted keys. Then, effects animators Bob Bennett and Dimitre Berberov set about creating the opening and closing of a multi-layered curtain. “This animation carried the volume and particle instances with it and an additional Pyro sim was run from the curtains edges for integration and extra sauciness,” says Erickson.
The Role of Foundation Effects
Using the TempFx tool in its Foundation Effects tool suite, Walt Disney Animation Studios was able to create lower resolution water proxies as rigged assets in Houdini for early cross departmental collaboration, including for generating water FX. “Having this option was key as it allowed for departments such as Layout and Animation to compose cameras and characters to a quick GL visualization of the water effects,” explains effects lead Ian Coony.
“This was especially useful for Elsa’s character interaction running atop the wave swells of the Dark Sea – giving the character animators foot placement reference on the water. As rigs were created, they could be published as assets with adjustable timeShift controls built in for per shot timing tweaks.”
Similarly, this approach helped in creating early sims for the canyon flood which, says Coony, “forced careful planning of the scale of the canyon set. The initial scale from modelling was adjusted down by 50% once the early FLIP sim tests came back and revealed there was an issue with water speed. Once the speed of the water was agreed upon, these water assets were handed off to Layout for camera staging.”
Making the Nokk
Observation of horse behavior led the design and animation of the Nokk, with effects lead David Hutchins observing that particular attention was paid to emotional states. “Our goal was to preserve the subtle expressions, poses and gestures created in animation while layering on the motion and light response we expect from water,” Hutchins says.
Effects artists began their shots using the Nokk body motion provided by character animation and mane and tail curves from technical animation. The mane and tail curves were used as the source for POP simulations, which modelled fluid-like behaviour using force vectors derived from the local distribution of neighbouring particles, implemented as a POP VOP.
“This base sim,” advises Hutchins, “was used for three rendered layers: meshed using Particle Fluid Surface and shaded with a water material, rasterized to a volume and rendered with a volume shader, and directly rendered as opaque points for small detached droplets. Finally, using these points as a source, a Pyro sim was run to model very lightweight ‘spindrift’ particles, also rendered as opaque sub-pixel points. The body surface geometry was remeshed to a resolution that would support hydrodynamic motion, and ripples added via layered noise and/or a Ripple Solver which could react to body motion or collide with intersecting objects. For the body interior, we added view-dependent volumetric structures which included vector fields defining albedo and emissive light contribution.”
Hoof interaction with the ocean surface also became an important focal point. There was a design goal at Walt Disney Animation Studios to support the look of water interacting with water, as opposed to a hard surface interacting with water. Says Hutchins: “There was break up, deformations and stretching added to the legs by animators, and once in our hands, the goal was to further augment this concept. Particular attention was paid to the shapes of trailing water from the legs, these shapes were established by shaping our particle sources using trailing curves smoothed via resampling and converting to nurbs.”
For shots in which the Nokk transitions from water to ice, two different techniques were used. When underwater, the transition started with ice crystals growing inside the body surface using animated geometry instanced to scattered points, followed by a transition from water to ice material via a Solver SOP generated mask.
“The ice crystal patterns were provided by look development and matched Elsa’s signature snowflake shapes. In the above water case, the effect was achieved via an articulated mask generated via a Solver SOP, which was used in lighting to transition from water to ice materials. The transition was enhanced with ice crystals and water vapor advected by Pyro simulations.”David Hutchins, FX Lead
The Fire Spirit and Forest Fire
Another magical element to Frozen 2 involved fire, both for shots involving the fire spirit and the forest seen on fire. To create the forest on fire, artists first optimized their pipeline with the help of the technical director (TD) team in order to have an asset library of trees that would already contain the fire.
The layout artists and effects artists, normally separated by several steps in the pipeline, then collaborated heavily early on in production when it came to fire in the Enchanted Forest. “Instead of waiting for the effects artists to implement fire in a shot, the layout team was able to visualize where the fire would be and which trees would be on fire during their earlier stage of production,” outlines effects lead Marie Tollec. “This enabled the layout artists to place the camera accordingly, in order to have interesting compositional framing as well as enable them to identify which trees would be on fire themselves, rather than have the effects department to do it later in the pipeline.”
The tool that enabled this – dubbed Firestarter – was developed by the TD team in Python. Through viewport selection, a layout artist could highlight the trees to be set on fire. Those trees would appear pink in the Maya viewport and layout would be approved this way. On the effects side, the simulation was made in Houdini using Pyro on each tree at the origin. Then the fire VDBs were published, alongside their Hyperion shader material as well as the particles used for the embers. (Hyperion is Walt Disney Animation Studio’s proprietary renderer).
“These fires were published at the asset level of the pipeline. This way, every time a tree was dropped from the asset list into a 3D scene, the artist manipulating the tree, from whatever department they were in, had the choice to select the onFire version of the tree that would contain all the fire information.”Marie Tollec, FX Lead
That approach enabled all the set-dressed fire, which was then supplemented with custom pyro simulations added by effects artists. The sim interacted with elements and characters in the scene and would be ‘put out’ by Elsa’s magic. Tollec adds that the team worked with the film’s production designer to come up with a more magical look to the flames and ended up re-mapping the heat field to push the colors towards the purple/magenta range.
Finally, in relation to the fire spirit itself – which took the form of a salamander – artists relied on a pyro simulation with embers only present at times of extreme emotion. Tollec also comments that “the material for the salamander had two variants with a spicy (on fire) and a non-spicy version. The simulation itself was made on the moving salamander, with traditional techniques to pre-slow down/minimize the motion when it was too extreme.”
Gale, The Wind Spirit
Most of the spirits in Frozen 2 are effectively ‘visible’ in some form or another. The wind spirit, Gale, however, was necessarily ‘invisible’, and only showed up as the influencer of the environment around it. This led to a need to animate environment assets to a level not previously done before at Walt Disney Animation Studios.
To start the process, character animators were provided with a rig in Maya that allowed them to visualize the position, directionality, width, and length of Gale’s influence on the environment. Effects lead Ben Fiske explains this further: “While most animated this rig as they would any other character, VR enabled rigs were also available, allowing some to dive directly into the scene and animate via body motion alone. From there, curves were written out as bgeos containing common point attributes that would help drive the interaction.”
The impact of Gale necessitated a deep collaboration between FX and the environment teams. “The environments,” says Fiske, “were authored using a variety of proprietary procedurals that arrived in a variety of different formats but, critically, all had hooks leading back to geometry data stored on disk as bgeos. By having bgeos alongside Disney’s CAF format, effects artists were able to use custom OTLs to quickly load an entire environment’s worth of instanced procedural environment assets using delayed load packed primitives, animate them, and write those back out into the pipeline.”
“By using packed primitives, the data sets being manipulated were extremely lightweight and, in most cases, assets like fallen leaves and simple plant life could be animated on a single point per plant basis, never needing unpacking. This allowed artists to leverage DOP solvers like POPs, and in some cases, the new Vellum solver, resulting in quick iterations and extremely simple approaches.”Ben Fiske, FX Lead
Gale’s presence in the film sometimes takes the form of a tornado and a billowing flurry of snowflakes. The tornado appearance relied on Houdini’s Pyro solver in conjunction with instanced volumes and debris that were manipulated in SOP context. “For shots shown inside of the tornado funnel,” states Fiske, “this workflow of using SOPs for the instanced volumes and debris allowed for specific art direction with regards to speed, amount, and hitting story points important to the shots.”
Then, for the snowflakes-related shots of Gale, artists advected points through a billow Pyro sim at the origin that were point deformed into place using the data provided by the animation department. “These points were later instanced with snowflakes and smaller particulate, and an additional volumetric pass was layered in using the base Pyro sim,” says Fiske. “Simple solutions for complex looking problems.”
The Earth Giants
Earth spirits, in the form of giant rock formations, were characters that were realized in partnership between animation and FX. Fiske notes that the studio was able to leverage work that had already gone into animating trees and vegetation with Gale. This included utilizing constrained curves run through Houdini’s Vellum solver; here, artists expanded on the idea by building out automated rigs in SOPs that tracked the footsteps of each of these giants.
“Using these footsteps,” says Fiske, “a growing ripple was instanced that all of the vegetation rigs were looking for to apply a downward shake force, allowing for not only a falloff on intensity but an offset in timing.”
In addition to the tree shake, the giants interacted heavily with the surrounding forest. Forest interactions were aided by the Vellum curve-based workflow established with Gale. This allowed for direct collisions with branches and the Earth Giants, while constrained sectioned RBDs were also set up for all of the tree modeled trunks, allowing for a complete, deformable tree simulation.
“Beyond this,” advises Fiske, “logic was added to release leaves from the trees with enough force applied to the branches, which were then simulated in POPs. With all of these pieces in play, the true chaos of angry Earth Giants walking through a fully dynamic forest was possible, down to the last leaf.”
Destruction FX
For the dam sequence, Walt Disney Animation Studios had to not only simulate the rushing water, but also its destruction. “As Marie Tollec outlines, “the destruction of the dam was to be at the climax of the movie and we needed to create a complex workflow that would include almost every department to set it up correctly, from visual development, modeling, layout, effects, animation, and lighting.”
Since the sequence would be very much effects-driven, the workflow for destroying the dam was approached differently than most in the film. The effects and the way the dam would shatter would affect not only the layout and camera placement but also come into play before the animation. This was so that Anna, who runs on the dam, would be able to react to the environment being destroyed around her, in addition to her feet making foot contact on the structure.
“The workflow,” attests Tollec, “allowed for a great performance in the character emoting as well as an optimized model construction and destruction. The dam appears in a number of shots and needed to be optimized for both closeup and far away shots. The model was also designed so that every piece would be unique in the combination of size, texture, displacement, moss and construction marks.”
Once the rigid body simulation was director-approved, it would go to layout for camera readjustment, then character animation and technical animation, before circling back to effects where, says Tollec, “we would add secondary dust, debris and particulates, alongside running the water simulation. In most cases, the water simulation was run after the destruction, with the water reacting to the RBD rather than the other way around. The continuity of the action also allowed us to optimize the simulations by running a longer simulation which would span over several shots. This was also helped by the fact that the events and timing of the sequence were choreographed through rough previz ahead of time by our Heads of Effects.”
Ice Visions
Two musical sequences in Frozen 2, ‘Into the Unknown’ and ‘Show Yourself’, called for an alternative take on Elsa’s magic effects. In them, a mysterious force dazzles her with visions of the elements of nature and premonitions of events to come.
“These effects necessitated a high degree of specificity which we achieved using a combination of procedural and keyframe animation techniques,” details effects lead Alex Moaveni. “We would dial-in the animation on an individual component, such as a deer or tree, then scale up using Python scripts and our proprietary scene archive distribution system, Toolshed.”
“We added a hand-animated quality to these effects using a rotomation toolset we wrote using Python wrapped around Houdini’s stroke SOP. Animating curves or surfaces natively gave us consistent UV’s to stick instance points to, important for controlling motion.”Alex Moaveni, FX Lead
For some shots, adds Moaveni, artists keyframed individual points, while for others they used a procedural VEX method in a ‘quasi-POPs-like’ way to sample positions on curves or surfaces using a normalized age attribute. “To our benefit we could scrub in real-time and use ramps or curve functions to affect the apparent energy of the points.”
Elsa’s Magic
Amongst all of these other effects challenges, Elsa’s magic still plays a key role in the storytelling. Effects lead Thom Wickes identifies this as being all the way from the “lyrical, playful magic in earlier sequences to the more powerful magic she uses when extinguishing magical fire or fighting for her life in the dark sea.”
The broad variety of magic effects meant the studio adopted a more flexible, modular toolset for this work. “Most magical effects were largely SOPs-based,” says Wickes, “with simple geometry used for blocking in the effects. We used curves for the more whimsical effects, and larger cone shapes for the aggressive blasts. This allowed effects artists to focus on placement, shape, and timing, before generating the final data.”
“The more playful magic relied more on particle snowflakes advected along curves in POPs with supplementary mist and glow volumes,” continues Wickes. “For the larger blasts, we used procedural noise textured volumes moving through a deformed coordinate space, this data was used to generate additional mist, particles, and frost material overrides.”
Effects and Storytelling
As it had done on several recent productions such as Ralph Breaks the Internet, Moana, Zootopia and Big Hero 6, Walt Disney Animation Studios sought to leverage continual developments in FX for Frozen 2. And, as the observations from the team above show, this was also done in collaboration with the rest of the entire studio, making that FX work fit right into the final frames.
Source: SideFX
