Get Even More Visitors To Your Blog, Upgrade To A Business Listing >>

How an AI neural network brought Luke Skywalker's voice to The Book of Boba Fett

At the end of season 2 of The Mandalorian (which aired in December 2020, so spoiler alerts are meaningless but here we are), a DeepFaked CGI version of Luke Skywalker makes a surprising appearance to recruit the young Grogu for his upcoming Jedi revival scheme. It was both a cool and creepy moment, with the impressive digital imaging nestling way too comfortably in the heart of the Uncanny Valley. It was so ineffably unsettling that a random YouTuber tried to fix the scene himself — and did such a good job that Disney hired him.

When CGI DeepFake Luke Skywalker returned in The Book of Boba Fett, his robotic performance was noticeably more convincing. But there was something about his voice that was still … off. (In my group chat with my friends about the show, it was the first thing I commented on.) There was apparently a good reason for that: it was made entirely with AI. From Esquire:

Hamill didn't record lines for The Mandalorian, according to Jon Favreau. In Disney Gallery: Star Wars: The Mandalorian, he revealed, "Something people didn't realize is that his voice isn't real. His voice, the young Luke Skywalker voice, is completely synthesized using an application called Respeecher." 

Read this horrifying description of Respeecher from a sound editor who worked on the series, Matthew Wood: "It's a neural network you feed information into and it learns," Wood says. "So I had archival material from Mark in that era. We had clean recorded ADR from the original films, a book on tape he'd done from those eras, and then also Star Wars radio plays he had done back in that time. I was able to get clean recordings of that, feed it into the system, and they were able to slice it up and feed their neural network to learn this data."

Whereas Luke's physical performance was created by blending Mark Hamill with a younger actor, Disney apparently decided that it wasn't worth their time to hire noted VoiceOver artist Mark Hamill to voice a character played by Mark Hamill, and outsourced the job to a computer instead.

This is both creepy, and impressive, because it won't be long until that VoiceOver technology climbs out of the Uncanny Valley.

The Unbridled and Mildly Horrifying Evolution of CGI Luke Skywalker [Brady Langmann / Esquire]

  • Brilliant Star Trek vs. Star Wars trick in the New York Times crossword puzzle

    In Sunday's New York Times crossword puzzle, constructor Stephen McCarthy embedded a wonderful trick centered on the Star Trek vs. Star Wars debate. For the clue "The better of two sci-fi franchises," either answer works. From the Constructor Notes: I am a fan of both "Star Wars" and "Star Trek," so it's nice to be… READ THE REST

  • A pop-punk montage of people going places in Star Wars

    The Auralnauts have made a delightful career out of making silly Star Wars songs on YouTube, but their latest bop is a whole new level: a generic-ass pop-punk anthem that celebrates every moment in the saga when someone gets ready to go somewhere. It fits the genre so perfectly. I love it, and I hate… READ THE REST

  • Star Wars Cantina song performed on classical guitar

    Kenner Toys, Cincinatti, early 1977. KENNER TOYS EXECUTIVE: George, we love the designs for the cantina band toys and the copy's fantastic. But I was wonde— GEORGE LUCAS: Ah yes, the Jizz Wailers. EXECUTIVE: I was wondering if we might change their name to someth— GEORGE: No. They are Jizz Wailers. READ THE REST

  • Charge your life, at home and away, with $249 off this portable power station

    We thank our sponsor for making this content possible; it is not written by the editorial staff nor does it necessarily reflect its views. You've set the picnic table with your signature grilled cheese sandwiches freshly prepared for your family. The tents are entirely constructed, ready for a cozy night of sleep in the mountains.… READ THE REST

  • Learn Python, JavaScript, and more with this programming bundle, now just $21

    We thank our sponsor for making this content possible; it is not written by the editorial staff nor does it necessarily reflect its views. Whether you're looking for a job you can do from home or want to secure a higher salary in your position down the road, learning to program is an excellent opportunity… READ THE REST

  • Bring your workstation with you with this adaptable laptop stand for $30

    We thank our sponsor for making this content possible; it is not written by the editorial staff nor does it necessarily reflect its views. Traditionally, laptop stands are convenient for making your hands and wrists comfortable while typing or correcting the height of a desk that's too short for you. But they're rigid and, if… READ THE REST



This post first appeared on Bluzz, please read the originial post: here

Share the post

How an AI neural network brought Luke Skywalker's voice to The Book of Boba Fett

×

Subscribe to Bluzz

Get updates delivered right to your inbox!

Thank you for your subscription

×