Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal Sony video reveals ongoing experiments with AI-powered PlayStation characters. The Verge reported on this video, allegedly from PlayStation Studios' advanced technology group, showcasing Aloy from the *Horizon* games as an AI character. The video's subsequent removal from YouTube following a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client) lends credence to its authenticity. IGN has reached out to Sony for comment.

The video, as detailed by The Verge, features Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, conversing with an AI-powered Aloy. This interaction uses OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) for speech, and Sony's Mockingbird technology for facial animation.

The AI Aloy's voice differs significantly from voice actor Ashly Burch's portrayal, exhibiting a robotic quality. Her facial animations are also stiff and lack expressiveness. During the conversation, Aloy reveals her identity as a clone of Dr. Elizabeth Sobeck, discussing the implications of this revelation.

The demo seamlessly transitions into the *Horizon Forbidden West* game world, allowing Raghoebardajal to continue the conversation within the game environment. This juxtaposition highlights the novelty and potential challenges of such technology. The irony of using Aloy, whose story centers around her origins, as an AI demonstration is not lost.

The prototype, developed with Guerrilla Games, serves as an internal demonstration of Sony's AI capabilities. While showcasing significant investment in AI-powered characters, Sony hasn't confirmed plans to integrate this technology into any public PlayStation products. The feasibility for current PS5 games remains unclear.

Sony's exploration of AI isn't surprising, given the industry-wide interest in this technology. Microsoft, for example, recently unveiled Muse, an AI designed for game design ideation. However, generative AI faces criticism due to ethical concerns, rights issues, and its limitations in producing consistently engaging content. Keywords Studios' failed experiment using entirely AI-generated game content illustrates these challenges.

Despite these challenges, major players like EA (which described AI as "the very core" of its business) and Capcom (experimenting with generative AI for environmental design) are actively pursuing AI integration. Asad Qizilbash, Head of PlayStation Productions and Head of Product at PlayStation Studios, highlighted the importance of AI-driven personalization for Gen Z and Gen Alpha gamers, emphasizing the potential for more meaningful interactions with non-player characters (NPCs).

Activision's recent admission of using generative AI for some *Call of Duty: Black Ops 6* assets, amidst criticism regarding an AI-generated loading screen, further underscores the industry's complex relationship with this technology.

What's The Best PlayStation 5 Game?

Pick a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results