Mercedes-Benz is further leveraging AI to expand the capabilities of its MBUX Voice Assistant with the introduction of a general knowledge function. Using AI, the MBUX can now provide up-to-date answers to questions by initiating a Microsoft Bing search, and creating natural language responses using ChatGPT through Microsoft Azure OpenAI Service.
Mercedes-Benz was one of the first car makers to introduce ChatGPT as a US beta program and is now bringing this functionality into series production vehicles. With this feature, customers can ask a variety of general knowledge questions the system can also respond to follow-up requests for additional information, even if the speaker uses vague wording.
“By adding an AI-driven knowledge feature to our MBUX Voice Assistant, we are making it even easier for customers to connect with their vehicle in an entertaining and rewarding way. Our unique AI software seamlessly interacts with ChatGPT and Bing through Microsoft Azure OpenAI Service to deliver information like never before” said Markus Schäfer, member of the board of management of Mercedes-Benz Group and chief technology officer, development and procurement.
Users can activate the assistant by simply saying “Hey Mercedes”. Alternatively, they can press the speech button on the steering as well. To maximize the functionality, the dialog history is stored for up to one hour, enabling the user to ask follow-up questions. The new function is available as a free update to over three million vehicles globally with the MBUX infotainment system. It will initially be offered in three languages: German, British English and American English. Mercedes says that users from other markets can change their system language to try out the feature.
The company also stated that it retains complete control over the IT processes in the background. All voice command data collected is stored in the Mercedes-Benz Intelligent Cloud, where it is anonymized and analyzed. To mitigate the risk of customers accessing toxic, harmful or illegal content, Mercedes-Benz has implemented a risk assessment tool to evaluate system responses and identify best practices to reduce the possibility of harmful responses.
