Sony's advanced technology group has created a prototype AI version of Aloy, a character from Horizon Forbidden West. This AI can engage players in conversation through voice prompts during gameplay. The development was led by Sharwin Raghoebardajal, who detailed the technology's capabilities, including the use of OpenAI's whisper for speech recognition, GPT-4 and Llama 3 for conversational AI, and Sony's Emotional Voice Synthesis for speech generation. While the demo was initially run on PC, Sony is also adapting it for PS5 consoles with efficient performance.
While the demo is seen running on PC, Sony has also experimented with running parts of this technology directly on PS5 consoles with "little overhead," according to Raghoebardajal.
Raghoebardajal demonstrates an AI-powered version of Aloy that can hold a conversation with a player through voice prompts during gameplay.
Collection
[
|
...
]