Square Enix has filed a patent for a tech that can have some very interesting applications. Future games from Square Enix might allow you to speak with NPCs via voice commands and get dynamic responses. This patent describes a technology for teaching a computer system how to understand and process human voices and then use this understanding to control and interact with animated characters. The tech can help in building characters that can interact with the player in real-time using voice input. Characters could respond with dynamically generated facial expressions and body movements that correspond to the tone, emotion, and content of the player's speech, for better immersion and engagement.
If developers combine this tech with generative AI, something like Nvidia ACE, imagine the results. Now, this is just one possible use case for this patent. Another is what I call "Advanced Lip-Syncing." Automatically generating accurate lip-syncing for characters in multiple languages without manual animation. This would not only save development time but also create more realistic and engaging dialogues in games. But a lot more can be done with this including amazing new accessibility features. This technology could also be a boon for accessibility, allowing players with physical disabilities to control characters and navigate game worlds more easily through voice commands. It could make games more inclusive and enjoyable for a wider audience.
When, if, and how this tech is used by Square Enix remains to be seen but the possibilities are exciting to think of.
respawnfirst.com
