Cerence Deepens Partnership with NVIDIA

Advertisements

As the automotive industry continues to embrace the wave of intelligence, in-car voice assistants emerge as a fundamental bridge between drivers and vehiclesThe efficacy of these systems profoundly impacts the driving experience and, crucially, safety on the roadsRecent developments highlight the competitive landscape, such as a significant partnership announcement made on January 3rd by Cerence, a leading American AI voice technology company.

Cerence disclosed an expanded collaboration with tech giant NVIDIA to enhance the performance of their language models within its onboard systemsThe announcement triggered a surge in Cerence's stock in the pre-market, soaring over 32% initially and achieving gains of over 70% before settling down, marking nearly a 165% rise over the past six monthsThe collaboration aims to refine the capabilities of their voice assistants, making them more responsive and reliable in various driving scenarios.

In the competitive arena of automotive AI, companies like SoundHound and Nuance also vie for dominance, each offering their proprietary voice assistant and intelligent interaction technologies

Analysis indicates that leveraging NVIDIA's technological prowess could enable Cerence to not only cut development expenses but also expedite the rollout of new products and features.

This merger with NVIDIA, a powerhouse in the AI space, undoubtedly lends substantial credibility and technical strength to Cerence, which previously held a mere market capitalization of $334 millionNVIDIA’s leading-edge AI infrastructure is poised to be a significant resource for Cerence, allowing for the design and production of more sophisticated language models and onboard systems.

As consumers’ expectations for in-car voice assistants grow, particularly with the increasing complexity of smart car functions, they now demand that these systems deliver both speed and accuracyAdditionally, drivers expect these voice assistants to maintain reliable performance under challenging conditions while ensuring personal data remains secure

However, neither cloud-based nor edge computing solutions alone can adequately meet these emerging needs.

Cloud solutions involve processing complex voice commands through external servers, which, despite their formidable computing capabilities, suffer from issues like reduced responsiveness when internet connectivity is inconsistent and potential data leaks during transmissionConversely, edge computing, which operates directly within the vehicle, can efficiently execute straightforward commands like "open window" with quicker task completion and enhanced privacy protections since no data is transmitted to cloud serversHowever, this method often struggles due to the limited computational resources available in vehicle hardware, restricting the execution of complex AI models and, subsequently, the potential for feature expansion.

By offering a dual approach that integrates both solutions, Cerence diversifies its market offerings while also mitigating the risks associated with technological constraints

This “cloud + edge” strategy not only enhances flexibility for Cerence but also increases the appeal of its solutions among automotive manufacturersThe collaboration with NVIDIA signifies a noteworthy advancement within the automotive AI deployment sphereCerence aims to capitalize on NVIDIA’s robust AI Enterprise software and DRIVE AGX Orin hardware platform to optimize both its CaLLM (cloud language model) and CaLLM Edge (edge language model) for superior performance.

Utilizing NVIDIA’s DRIVE AGX Orin onboard hardware will allow Cerence to deliver localized AI functionalities that are vital in scenarios where a stable network connection cannot be guaranteedAdditionally, NVIDIA will facilitate access to TensorRT-LLM and NeMo frameworks, addressing common challenges faced by in-car AI assistants.

These challenges include latency, performance limitations, and high resource consumption

alefox

In high-stakes driving scenarios, the ability of an AI assistant to respond almost instantaneously can be a matter of life and deathCerence’s partnership with NVIDIA seeks to mitigate these issuesThe TensorRT-LLM provides in-depth optimization of AI models, enabling maximum performance despite hardware constraints in vehicles.

Moreover, inefficient resource use can lead to significant power consumption, diverting valuable computational resourcesNVIDIA's enhancements aim to reduce energy use and resource allocation, allowing sophisticated technologies to run on hardware-constrained automotive devices smoothlyAn AI assistant that misinterprets a driver's command poses tangible risksNotably, Cerence is implementing NVIDIA’s NeMo Guardrails technology, functioning as a safeguard that filters incorrect or unsafe commands and prevents malicious input, such as attempts to engage the assistant in generating hazardous content

This system serves as a critical component in keeping drivers and passengers safe.

In recent financial reports, Cerence noted an annual revenue of $331.5 million, boasting an impressive gross margin of 73.7%. Its fourth-quarter results reported revenues of $54.8 million, exceeding projections, despite a negative adjusted EBITDA of $1.9 millionThe company anticipates generating $25 million in free cash flow by its fiscal 2025. Cerence has also revealed an ambitious shift towards generative AI, focusing on regaining profitability by 2025.

Nils Schanz, the Executive Vice President of Cerence AI Products and Technologies, expressed, "By optimizing the performance of the CaLLM language model series, we are saving costs and enhancing performance for automotive clients who are rapidly deploying generative AI solutions for their driversAs we advance towards the next generation platform built on CaLLM, these advancements will offer drivers quicker, more reliable interactions, all of which enhance their safety, enjoyment, and productivity on the road."

Rishi Dhall, NVIDIA’s Vice President of Automotive, conveyed the potential that large language models offer for innovation in user experiences but acknowledged that challenges with scalability and complexity could hinder developers from delivering AI-driven solutions to end users

Leave A Comment