I finally understand how AI is trying to change the way we play.

The tool is still in the testing stage, but Project G-Assist has already become one of Nvidia’s most exciting new products for gamers. A chatbot with artificial intelligence that can capture and analyze what appears on the screen. An assistant that we can ask everything we need, from which weapon is the best to kill boss And finally, what armor will provide us with the greatest protection.

But it’s not just about gaming. G-Assist goes much further. During a visit to Nvidia’s Munich office, we were able to test out its new AI assistant, and while it’s clearly a demo, it was enough to convince us that it is. This is a natural path for integrating AI into video games..

It’s not a scam, but it helps a lot.

The Project G-Assist demo includes the game ARK: Survival Ascended. At the moment, Nvidia is only partnering with Studio Wildcard to implement the tool.

We have small an external window displayed on top of the game and allows us to ask him by voice or text. The novelty, besides the fact that it is similar to talking to ChatGPT or another assistant, is that on the one hand it analyzes what appears on the screen, and on the other hand it has specific information about the game.

ARK is a game full of dinosaurs. One of the questions we can ask is, for example, “What dinosaurs appear on the screen?” Another option is to ask “What is the best weapon to start the game?” G-Assist will answer us without any problem. as if we had immediate access to the official wiki of the game.

In the past, when we played games, we were blind. But today, in almost all games, all information is available online. The G-Assist project is a natural step in this direction. In the coming years, if we have questions about an object or how to scroll the screen, AI will help us in a matter of seconds.

What’s interesting here is that the information that the assistant returns to us is updated for our character. For example, we can ask you for advice on our current team, this tells us what the recommendations are for getting the next skill points or where we need to go to get more objects of a certain type.

Isn’t this a scam? – we asked the Nvidia team. Your answer is no, because Project G-Assist is being developed in collaboration with the game’s creators. That is, If the game creator doesn’t want the AI ​​to tell you something, it won’t.

Mainly because the data you have access to is provided by the game developer itself. The G-Assist project is not based on publicly available data or data created by the gaming community, but on the developer’s own database.

This also helps us optimize the game.

The G-Assist project is not limited to an assistant that transmits information. It is also capable of analyzing the gaming session and offering us technical data, as well as changing the gameplay. For example, we can ask you show us a graph with temperature data in the last five minutes or show us a comparison of CPU and GPU usage.

We may also ask you to provide an average FPS. We can vary the time here, but if we ask you to make a very large calculation, your response time will be longer.

In addition to information, we may also ask you to change settings such as maintain a certain SPF level This causes GPU usage to be below a certain level; enable DLSS or enable GPU overclocking.

That’s because it’s integrated with the GeForce Experience automatic optimization tool. For the most advanced players, this wizard will certainly be short, but for many others who want to quickly get set up, it’s a great way to tailor the game to their liking. According to Nvidia, you may need to restart the game to apply the changes we requested.

Project G-Assist uses various LLMs to operate and switch from speech to text. Currently, only in English and based on the ElevenLabs model. For speech synthesis, it uses Nvidia’s own LLM, Riva. And for text generation and responses, it is based on the OpenAI LLM, without specifying which version of GPT is used.

One of the questions we asked Nvidia was about the training data. Project G-Assist has optical character recognition capabilities that allow it to see what is happening on the screen, but if, for example, the game is updated and its missions or objects change, the AI ​​may return the wrong answer. Here, as is usually the case with AI assistants, active support from the developer will be required to ensure that G-Assist responses are accurate and up-to-date.

Starting next year

Project G-Assist is a concept, but Nvidia says it’s working to bring it to developers “later this year.” There’s no confirmation of a date, but it’s possible it will happen. along with the upcoming Nvidia GeForce RTX 50which are scheduled to arrive at CES 2025 in January.

There is also no confirmation on how G-Assist will be offered in the final version. It may be due to an update of the Nvidia application. What they explain to us is that the consumption is very low, as it only analyzes the logs of previous frames and provides an answer if necessary.

In fact, G-Assist, being an external layer, could theoretically work even with games it’s not designed for, although all the fun of the tool is lost because the information won’t be accurate enough to be useful.

Our concerns about Project G-Assist are similar to those we have with other AI tools. The potential is huge, but it’s hard for developers to fully utilize it. Nvidia has created a help guide for gamers that is very easy to use, useful, and helpful. We wouldn’t mind seeing her in every possible game.. This is a great example of what AI promises us. Instead of searching for something manually, just ask what we need and get an answer instantly. Whether we will be agile enough during the game to hunt dinosaurs depends on us.

In Hatake | It was only a matter of time before generative AI reached video game development: This is how Microsoft will push it on Xbox