The world is slowly leaning on to the magic of Artificial Intelligence (AI) and now, the gaming industry’s major names such as Ubisoft and Tencent Games have made themselves available and have their gaming experiences even more interactive with AI-powered NPC tools from NVIDIA.
NVIDIA ACE converts writing to speech with realistic conversations
During the Consumer Electronics Show (CES) held on January 8, 2024, NVIDIA presented the most recent strides in its generative AI-powered Non-Player Characters (NPCs). Called the Avatar Cloud Engine (ACE), the demonstration featured automated dialogues between players and computer-generated characters, presenting a potential shift in the way games are developed.
Curious how it works? Well, let me simplify it for you. It uses computer programs that can work over the internet or right on your computer. When you talk to the computer while playing a game, ACE understands your words with the help of a special listening program. Then, it turns what you said into writing.
Next, ACE uses another program to figure out what the character in the game should say in response. Once it knows that, it makes the character “speak” by turning the written words into a realistic voice using yet another program, with realistic lip movements to match the words. Finally, the computer puts your animated character into the game so you can see and hear it talking just like you, and the convos will be different every time.
NetEase and HoYoverse are also among NVIDIA AI NPC tool enthusiasts
Furthermore, NVIDIA announces that game and interactive avatar developers are at the forefront of leveraging ACE and generative AI technologies, exploring innovative ways to transform interactions between players and NPCs in various games.
They have named several big-name publishers that are already on board, including Convai, Charisma.AI, Inworld, Genshin Impact and Honkai: Star Rail makers HoYoverse, NetEase Games, Ourpalm, and UneeQ as those who have embraced ACE apart from the mentioned two. There can be more of such names actively participating once the service is widely available.