Microsoft gives its AI Copilot voice, vision, emotional intelligence and reasoning ability

New York/Voice, eyes, emotional intelligence and reasoning ability to be a “companion” that users can turn to not only for ask for helpbut also for discuss.

Here are some of the features that Microsoft announced to his assistant artificial intelligence generative, Co-pilotat an event in New York, where Mustafa SuleimanCEO of Microsoft AI, said that computers have learned the language of people and it is “completely changing paradigm interactive between both.

“These machines now understand our voice. They can perfectly decipher what we say. They can react to our intonation. They have reached a level where you can maintain smooth, relaxed and informal conversation with themwhich are able to capture the emotional intelligence of your speech, so it seems as if you are having a normal conversation,” the co-founder emphasized Google DeepMind.

New voice of the co-pilot

According to Suleiman, at the moment Co-pilot’s voicechatbot with which the user can communicate with Copilot, doesn’t save conversations, nor does the company retain information for AI training.

This AI has four voices and is now available in Australia, Canada, New Zealand, UK and USA. in iOS and Android mobile applications, on the Internet at copilot.microsoft.com and through application Second Pilot for Windows.

According to Microsoft, Copilot Voice will initially be available in Englishbut during the demonstration, the EFE journalist managed to have a casual conversation with the machine in French and Spanish.

Like other AIs, their responses can be well-formed, but they can also be poorly formed. false information. Something known as hallucinationstherefore, the user cannot “talk” to the AI ​​about certain topics, such as elections, medical advice, or legal warnings.

“Until we have very high accuracy rates and very low false positive rates, we won’t expand into these other areas, but that time will come. This is a matter of several years,” Suleiman said.

Co-pilot’s new eyes and reasoning ability

AI eyes will be Co-pilot’s visiona chatbot that can see a user’s browser, understand both text and images, and provide advice or summaries of what it sees.

According to Microsoft, this application can be useful for organizations accommodation about a trip on Airbnb – since it can listen to the user’s preferences and, based on this, recommend a specific option – or choose a movie according to the opinions posted by critics on Rotten Tomatoes – because you can compile a summary of all the comments online.

This feature will not be available on all internet sites and is still available. in development. As such, the beta version can only be accessed through Copilot Labs in the US.

The company also presented Think deeper -which is also only available in Copilot Labs– in which the AI ​​takes more time to cause your answer, which the company believes allows you to answer a complex answer that provides, for example, a list of pros and cons.

“We designed it to be useful for all types practical and everyday taskslike comparing two complex options side by side. Should I move to this city or that one? What type of car best suits my needs? And so on,” Microsoft explains in a statement.

Personalized podcast every morning

The tech titan also announced Co-pilot DaleyAn audio summary of news and weather information that Copilot reads like a podcast.

“We work directly with Reuters, Financial Times, USA today... And we pay for this content. But over time, it will also include emails, calendar events, and daily tasks. The idea is really to summarize only what (the user) needs to know at dawn,” Suleiman explained.