ElevenLabs unveils enterprise voice platform at New York summit: model tuning, ElevenAI app, marketplace

US voice AI company ElevenLabs unveiled a package of enterprise products at its New York Summit on Tuesday, November 11: businesses will be able to fine-tune selected open-source language models and its voice models using data from live deployments, a new workplace app called ElevenAI will listen to meetings and take notes, and the company is launching a partner programme and an industry marketplace, alongside expanded compute with NVIDIA.

Models tuned on each company's own data

Businesses will work with ElevenLabs researchers to tune models for their own customers and operating context, choosing optimisation metrics such as customer satisfaction or reliability. Because the data comes from live deployments, companies can keep refining the models as interactions accumulate rather than relying only on a general industry model. The company already applies the approach in Scribe v3 Medical, a healthcare transcription model built to recognise specialist terminology, and a domain-optimised financial-services model is also in development. The customisation work is due to begin in the coming months.

An Interaction Engine to run the conversation

The previewed Interaction Engine decides how a conversation should run: it manages turn-taking and interruptions and can assign different language models to different parts of an exchange, using a cheaper model for triage and a frontier model for complex tasks, to limit token use. ElevenAgents, the platform for deploying voice and chat agents, will add Memory and Routines. Memory will recognise returning authenticated customers and distil each conversation into a structured record of preferences, constraints and future occasions, while the customer relationship management system stays the primary customer record. Routines is designed to automate multi-step work before, during and after conversations, such as pre-screening a mortgage applicant and calling back within minutes, reminding patients about visits and offering cancelled slots to waitlisted patients, emailing reports or writing to a customer relationship management system.

ElevenAI takes meeting notes; free early access opens

ElevenAI, aimed at employees, listens to spoken conversations, including in-person meetings, and produces notes, summaries and action items. It can also provide live assistance and pass context between people and agents. ElevenLabs says the app takes meeting notes with participants' consent and includes notice and consent mechanisms. Free early access opened with the announcement. Dictation and meeting notes use Scribe v3, the recorded-audio transcription model covering 102 languages.

More than 550 partners; purchases on the marketplace from 2027

ElevenLabs reports more than 550 partners across 44 countries, including Google Cloud, IBM, Deloitte, DXC and Genesys. The new Partner Program lets consultancies, systems integrators, software vendors and agencies integrate ElevenAgents into enterprise technology stacks or work with its forward-deployed engineers on complex deployments. An alliance with McKinsey and QuantumBlack, AI by McKinsey, was announced alongside it. The accompanying Marketplace initially offers a curated catalogue of partner-built applications for healthcare, financial services, insurance, education and retail. Enterprises can browse the applications and contact their developers; purchasing through existing ElevenLabs commitments is planned to start in 2027.

NVIDIA tie-up: new model live, 15 MW more compute

ElevenLabs and NVIDIA announced that Nemotron 3.5 Super VL is available in ElevenAgents and that ElevenLabs plans to add 15 MW of NVIDIA Vera Rubin compute capacity on top of its existing Blackwell Ultra systems, for large deployments with security or data-residency requirements and for its researchers. The expanded collaboration also covers an on-premises voice agent for Centralna e-Rejestracja, the central appointment system in Poland's national e-Health platform, with EasyCall supporting delivery. The agent calls patients who only have landlines to remind them about appointments and help them reschedule. ElevenLabs says the central system handles 40 million appointments annually with no-show rates of 10% to 20%, and the deployment uses NVIDIA Confidential Computing to keep citizen data and audio within government infrastructure.

CEO Mati Staniszewski said conversational agents would become “critical infrastructure for every enterprise, as essential as cloud or payments” within a few years. Sources: Unite.AI, ElevenLabs, Blockchain.News.