On viewFilm & Screen

Can A.I. Ease Hollywood’s Most Tedious Visual-Effects Task?

Foundry says SmartRoto can accelerate rotoscoping fourfold. Hollywood artists welcome faster tracing, but warn that fuzzy outlines and job losses remain unresolved on screen.

Can A.I. Take the Edge Off One of Hollywood’s Worst Jobs?
Can A.I. Take the Edge Off One of Hollywood’s Worst Jobs?JoshuaWoroniecki / pixabay

Programme

  1. Foundry estimates that SmartRoto can accelerate rotoscoping fourfold.
  2. A complicated five-second shot can take a week; an intricate one-minute scene can cost $75,000.
  3. In Dune: Part Two (2024), machine learning colored Fremen eyes blue after manual rotoscoping in Dune: Part One.
  4. More than a dozen Hollywood visual-effects workers reported time savings but described the A.I. tools as imperfect.
  5. An overwhelming majority of rotoscoping jobs has already moved to India because labor costs are lower than in the United States.

By Marcus Bennett

Foundry estimates that its SmartRoto tool can accelerate rotoscoping fourfold. The London creative software developer says its tool can find objects with one click. Users can trace an object and keep its shapes synchronized across frames. A few human adjustments often make the results usable.

Hollywood remains wary of A.I., but rotoscoping has drawn cautious interest. More than a dozen visual-effects workers in Hollywood said in interviews that the A.I. tools they tested could save time. They also stressed that the tools remained far from perfect.

Rotoscoping isolates a person or object by tracing around it in every frame. The process underpins effects that audiences rarely consider. In the original Star Wars (1977), it helped create Princess Leia’s hologram opposite Obi-Wan Kenobi. The light sabers did not glow without it either.

Sang-Jin Bae, the director of the Martin Scorsese Virtual Production Center at New York University, framed the wider problem: “A.I. is not a simple conversation.” He added that rotoscoping “is actually the perfect case study.”

A single scene can absorb hundreds of hours and thousands of dollars. Because each shot differs, experts hesitate to generalize about its time and cost. Reported estimates include:

  • A complicated five-second shot can occupy one person for a week.
  • An intricate one-minute scene can cost as much as $75,000.

Some artists call the process “roto.” It resembles cutting a person out of a photo in Photoshop, but it is far more complicated and time-consuming. Every moving character or object must be traced again in each frame. Artists often divide an object into sections, draw shapes and reposition them to follow its movement.

Jason Gottlieb, a longtime visual effects artist, described the labor at its most granular: “If you have an actor with long blond hair, and they’re flipping in the air fighting a robot, you need to roto every single hair. It’s the worst.”

Rotoscoping often falls to entry-level employees. Marti Romances, a founder and the creative director of Territory Studio, recalled doing it 20 years ago.

“I wish back then, that instead of spending the first two years of my career doing these tedious things, I could have done other things that would teach me more about creativity,” he said.

Machine learning has assisted moviemaking for several years. That predates the recent grouping of many advances under the A.I. label. In Dune: Part Two (2024), a machine-learning tool located all the eyeballs of the Fremen people. It colored them a radiant blue. Artists used countless hours of manual rotoscoping for that work in the earlier Dune: Part One.

Among the companies releasing tools this year were Adobe and Foundry. Their software can find objects and trace around them with a single click. It can also keep an object and its shapes synchronized across frames. The results seldom prove perfect. A few human-guided tweaks often make them usable.

Generative A.I. tools tend to cost less and prove more accessible to filmmakers. They offer an option for productions with budgets smaller than the Dune franchise. They can remove distracting power lines from a scene. The results often look soft, resembling a body against a video call’s virtual background. Artists say that softness looks far worse on a large screen.

Juan Salazar, Foundry’s creative director, rejected the idea of full automation: “Everyone asks for a magic button,” he said. “That button doesn’t exist.”

What does this change for rotoscoping workers?

The immediate change is less repetition, not the wholesale disappearance of the craft. Companies have already moved an overwhelming majority of rotoscoping jobs to India. Lower labor costs make that work more economical than in the United States.

Artists who remain stateside hope the efficiency will free them for more fulfilling filmmaking tasks. They do not want speed to translate directly into job losses. The companies testing A.I. still need trained artists to clean up substandard model output. The workers interviewed noted that fuzzy outlines do not win Oscars.

Many remain distressed, even enraged, by what they see as A.I.’s march toward control. Others consider the technology overhyped.

Maggie Kraisamutr, a longtime visual effects artist, drew a firm distinction: “A.I. is a tool, but that’s all it is,” she said. “It’s not a replacement for human beings who are creating art.”

Her distinction leaves the durability of that boundary unresolved. The next test for studios is whether they reinvest saved tracing time in more creative work or reduce entry-level positions. That choice will determine whether A.I. eases the slog or reshapes the workforce behind it.

Source: NYT Arts

artificial-intelligence, visual-effects, rotoscoping, hollywood, filmmaking

Also on view

« Previous articleNext article »