As first revealed in a behind-the-scenes special,
Disney Gallery: Star Wars: The Mandalorian, the voice of Luke Skywalker — in both
The Mandalorian and
The Book of Boba Fett — was “de-aged” using Respeecher’s technology. Magazines like
Esquire and other media outlets suggested that young Luke’s voice was “
completely synthesized.” But that interpretation isn’t entirely accurate. Respeecher didn’t just input a bunch of audio files into an A.I. and then have it spit out a de-aged Luke voice. It needed Mark Hamill.
“Professional voice input is extremely important,” Serdiuk explains.
“We don’t actually have any control over performance. That’s something that our technology doesn’t do. It doesn’t create a performance.”
Serdiuk uses a hypothetical dream project — having an A.I. Freddie Mercury perform live — as another example.
“Training the technology to make another singer sing in a particular voice is something our technology can already do. We can recreate the vocal apparatus of a particular person in a particular moment of their life,” Serdiuk explains.
“But the second part is still on humans. The whole performance. Speaking style. Inflections. All those tiny things that make our speech,” he adds. And it is not foolproof.
“[The technology] has problems with whispers. We don’t currently have control of that with our system.”