- Faster, more responsive voice AI experiences with lower latency
- Greater flexibility and resilience for enterprise voice AI deployments
Orange Business and NVIDIA are collaborating on distributed voice AI inference to help enterprises deploy natural, real-time conversational agents with lower latency, greater resilience and more control over where AI services run.
The approach distributes AI models across central-cloud and regional Point of Presence (PoP) resources, enabling workloads to be distributed across different locations to improve responsiveness, capacity and data location. This enables a natural conversational flow by reducing latency, while optimizing GPU capacity and bandwidth use, and helps keep voice data local where required.
A proof of concept for real-world AI operations
At GTC 2026, Orange and NVIDIA are piloting Distributed AI Inference across multiple sites in Orange’s network. Orange Business has deployed NVIDIA Blackwell at central cloud and NVIDIA Aerial RAN Computer at distributed locations for this pilot. The demonstration uses a wildfire emergency scenario, where AI helps in translating the conversation from a foreign language caller to operator’s language and vice versa, ensuring a seamless real-time call experience with the required translation accuracy and total time to response. AI also helps in transcribing, preparing call summaries capturing key information to assist the emergency service operators take speedy action to address the emergency situation.
AI models are accessed through Live Intelligence, Orange’s secure multi-LLM (Large Language Model) trusted AI platform, while the AI Distributed Inference platform manages workloads across central-cloud and regional PoP resources. Integrated routing balances traffic between sites and can redirect requests if a site is unavailable or overloaded.
To build this solution, Orange Business is integrating NVIDIA Nemotron models into Live Intelligence. These open weight models give customers access to advanced AI capabilities with the flexibility to audit, tailor and deploy them according to their operational and data-residency requirements. In addition, Orange Business brings together the network, cloud and regional infrastructure, model management and request routing required to operate distributed AI services end to end. This gives customers greater control over data processing, service operations and AI deployment locations, supporting data-residency and sovereignty requirements.
Expanding beyond conversational AI use cases
The service is designed to support other applications including emergency communications, live multilingual translation, enterprise contact centers, video analytics, drone detection, computer vision and industrial IoT.
In complementary work, Orange is assessing AI-RAN with Nokia and NVIDIA, initially focusing on potential gains in radio spectral efficiency, network capacity and site economics. The assessment also explores whether shared infrastructure could support both RAN functions and AI inference for future enterprise services, including sensing and drone detection, while maintaining radio network performance.
The distributed voice AI prototype is being tested with customers on real-world use cases. Their feedback will help Orange Business further refine the architecture, particularly its performance and resilience in a trusted environment.
“Distributed infrastructure is the next frontier of the AI factory buildout, as demand for inference and edge computing accelerates,” said Ronnie Vasishta, Senior Vice President of Telecom at NVIDIA. “Telcos are uniquely positioned to become distributed infrastructure service providers. With NVIDIA, Orange is expanding from the central to distributed sites, powering a new class of real-time intelligence applications that need deterministic performance, reliability and scale, and can be delivered together with connectivity using the AI-RAN architecture.”
“Distributed inference will be a critical part of the next phase of enterprise AI. It requires compute, connectivity and orchestration across multiple sites and regions,” commented Anne-Marie Thiollet, Chief Product and Marketing Officer, Orange Business. “Our extensive network and infrastructure footprint enable us to combine these capabilities together and help customers deploy AI services with greater performance, resilience and control.”
About Orange Business
Orange Business, the enterprise division of the Orange Group, is a leading network and digital integrator, supporting customers to create positive impact and digital business. The combined strength of its next-generation connectivity, cloud, and cybersecurity expertise, platforms, and partners provides the foundation for enterprises around the world. With 30,000 employees across 65 countries, Orange Business enables its customers’ transformations by orchestrating end-to-end secured digital infrastructure and focusing on the employee, customer, and operational experience. More than 30,000 B-to-B customers put their trust in Orange Business globally.
Orange is one of the world’s leading telecommunications operators. As of the end of 2025, Orange connects 340 million customers (including MasOrange) across 26 countries and generated 40.4 billion euros in revenues.
Orange is listed on the Euronext Paris (ORA). For more information: www.orange-business.com or follow us on LinkedIn and on X: @orangebusiness
Orange and any other Orange product or service names included in this material are trademarks of Orange or Orange Brand Services Limited.
Press contacts:
Emmanuelle Nahmany, Orange Business, emmanuelle.nahmany@orange.com
Séverine Belhomme Moisand, Orange Business, severine.belhommemoisand@orange.com
PR Archives: Latest, By Company, By Date