Machine learning was used to sync subtitles in Marvel’s Spider-Man 2

Sony is convinced machine learning and AI can be used to streamline development, and revealed it already leveraged the tech when developing Marvel’s Spider-Man 2.

The PlayStation maker shared the tidbit during a recent corporate strategy meeting where it outlined its long-term “Creative Entertainment Vision.”

The Japanese company said its 10-year plan will revolve around harnessing technology to “unleash the creativity of creators,” connecting diverse people and values to “foster vibrant communities,” and creating new experiences that “go beyond imagination.”

AI and machine learning to “support IP value maximization”The company didn’t specify which new technologies it’s hoping to deploy, but noted it’s already using AI tech and machine learning to “support IP value maximization.” What does that mean in practice? Sony claims it’s about finding new solutions to existing problems so franchises can be “delivered rapidly and at a low cost.”

Throwing out an example of that philosophy in action, Sony explained Marvel’s Spider-Man 2 developer Insomniac Games recently “utilized machine learning and applied original voice recognition software specialized for gaming” to enable the automatic synchronization of subtitles in certain languages. It’s claimed the technique “significantly” shortened the subtitling process by making it easier to sync subs with character dialogue.

There’s been plenty of AI chatter at Sony this week. Naughty Dog studio head Neil Druckmann advocated for the tech in an interview published on the company website and claimed it could “revolutionize” development and enable studios to “take on more adventurous projects and push the boundaries of storytelling in games.”

He said AI tools could reduce costs and clear technical hurdles for developers, unlocking their creativity in the process. “With AI, your creativity sets the limits. Understanding art history, composition, and storytelling is essential for effective direction. Tools evolve quickly—Some tools once essential, now are obsolete,” he continued.

“At Naughty Dog, we transitioned from hand-animating Jak and Daxter to using motion capture in Uncharted, significantly enhancing our storytelling.”

Sony isn’t the first video game company to hype AI tech. Other major players like EA and Microsoft are pushing the technology, claiming it’ll be a tool that empowers creatives across the industry while lowering costs. Some developers, however, are concerned that wielding AI (specifically the generative variety) as a cost-cutting device will invariably mean layoffs and downsizing.  

About the Author(s)

News Editor, GameDeveloper.com

Game Developer news editor Chris Kerr is an award-winning journalist and reporter with over a decade of experience in the game industry. His byline has appeared in notable print and digital publications including Edge, Stuff, Wireframe, International Business Times, and PocketGamer.biz. Throughout his career, Chris has covered major industry events including GDC, PAX Australia, Gamescom, Paris Games Week, and Develop Brighton. He has featured on the judging panel at The Develop Star Awards on multiple occasions and appeared on BBC Radio 5 Live to discuss breaking news.