Introducing Mercedes-Benz’s Next-Gen OS with a Smart AI Virtual Assistant

MB.OS: Finally Coming to Automotive Industry

After years of extensive development, Mercedes-Benz is preparing to unveil its latest operating system, which has been aptly named MB.OS. Created in-house, MB.OS was first showcased to the public at CES 2024. The cutting-edge system boasts a highly advanced AI virtual assistant, a range of partner apps for audio and gaming, and a state-of-the-art three-dimensional gaming engine that allows for intricate graphics.

The MB.OS software, separate from the MBUX infotainment system, displays significantly improved speed and efficiency compared to previous Mercedes systems, resulting in enhanced responsiveness and processing capabilities. One noteworthy improvement is the MBUX Virtual Assistant, which harnesses the power of generative AI and a patented language model to offer more authentic speech interactions and tailored recommendations based on daily routines and moods that mirror the driver’s own.

Currently, the MBUX voice assistant, commonly referred to as Hey Mercedes, has the ability to understand and respond to natural language commands. For instance, if you say “I am feeling hungry,” Hey Mercedes can provide recommendations for nearby restaurants. However, this is just scratching the surface of what the MBUX Virtual Assistant can do. It goes a step further by providing a summary of each restaurant’s menu and reviews, assisting the driver in making a more informed decision about their destination.Moreover, the MBUX virtual assistant is not limited to simply aiding with food choices. It utilizes artificial intelligence to suggest various functions and routes based on the driver’s routine. This includes features such as pre-booking parking ahead of time or adjusting calendar events if you are running late. Essentially, the goal of the MBUX virtual assistant is to make the driver’s experience as smooth and convenient as possible. Overall, Hey Mercedes may have been the first of its kind, but the MBUX Virtual Assistant takes it to a whole new level of innovative technology and helpful benefits for the driver.

The innovative Virtual Assistant is capable of personalizing its features to match the driver’s current mental state. Should it detect signs of frustration, its prompts and responses will be more concise and direct. On the other hand, if the driver is in a positive mood, Virtual Assistant’s voice will be livelier and have a more conversational tone. Additionally, it can express emotions through its “face,” which is depicted as a starry backdrop on the central display. The colors of the field will change and various emoticons will appear, conveying feelings such as “liking,” “celebrating,” “laughing,” and “confirming.”

3D maneuvering will be featured in vehicles containing MB.OS, utilizing the gaming platform for crisp visuals and precise driving guidance. The navigational screen will integrate essential driver assistance data, such as nearby vehicles and street signals, to establish a sense of reliability between the safety mechanisms and the driver. Furthermore, the elaborate display will suggest particular lanes and showcase augmented reality prompts in live action.

The latest 3D navigation feature also presents the surrounding environment such as buildings, current time, and weather conditions. Mercedes claims that this will aid drivers in making more informed decisions and gaining a clearer view of their route, minimizing disorientation in congested city areas.

An updated edition of MBUX is set to debut on vehicles featuring MB.OS, introducing an enhanced infotainment system with integrated Audible and Amazon Music. While enjoying audiobooks, radio plays, or music with Dolby Atmos capabilities, the sound system will coordinate the various speaker units, ambient lighting, and in-seat exciters for an even more immersive audio experience.

The upcoming MBUX will also incorporate a collaboration with Sony Pictures Entertainment to offer video streaming and Antstream for classic arcade games. Popular titles such as Gran Turismo and Spider Man: Into The Spider-Verse will be available, as well as a collection of vintage arcade games that includes a special running game created in partnership with Mercedes. Of course, these features are only accessible when the vehicle is stationary or utilizing Level 3 autonomous driving capabilities.

The initial utilization of MB.OS is set to debut on the released model of the Mercedes-Benz Concept CLA-Class, scheduled for release this year. Developed on the MMA platform, the forthcoming generation of CLA is designed to be highly suitable for electric vehicle use, while also providing options for traditional internal combustion engines.

The MB.OS system is set to expand its reach into other Mercedes product lines, coinciding with their updates and revamps. Additionally, certain features of the system will be accessible through over-the-air updates as part of the MBUX infotainment package.

Source: Mercedes-Benz