ElevenLabs Unveils Model Customization, ElevenAI and Partner Program

ElevenLabs announced on November 11, 2026 that it will help businesses fine-tune selected open-source language models and its voice models using data from live deployments, alongside a new ElevenAI workplace app and partner program introduced at its New York Summit.

The package extends ElevenLabs beyond voice generation and transcription into software for managing customer conversations and employee work. CEO Mati Staniszewski said conversational agents would become “critical infrastructure for every enterprise, as essential as cloud or payments” within a few years, framing the products as a broader enterprise deployment push.

Company-Specific Models and Conversation Routing

ElevenLabs plans to begin the customization work in the coming months. Businesses will work with its researchers to tune models for their own customers and operating context, selecting optimization metrics such as customer satisfaction or reliability. Because the data comes from live deployments, companies can continue refining the models as interactions accumulate rather than relying only on a general industry model.

ElevenLabs already applies the industry-specific approach through Scribe v3 Medical, a healthcare transcription model built to recognize specialized terminology. Staniszewski said a domain-optimized financial-services model is also in development.

The previewed Interaction Engine addresses a different problem: deciding how a conversation should run. It manages turn-taking and interruptions and can assign different language models to different parts of an exchange, using a cheaper model for triage and a frontier model for complex tasks. The design keeps routine exchanges from requiring a frontier model at every step and is intended to limit token use.

Memory, Automation and the ElevenAI App

ElevenLabs says ElevenAgents, its platform for deploying voice and chat agents, will add Memory and Routines. Memory will recognize returning authenticated customers and distill each conversation into a structured record of preferences, constraints and future occasions, while leaving the customer relationship management system as the primary customer record. A customer who prefers Spanish and can only talk after 5 p.m., for example, would not need to repeat those details on the next call.

Routines, also forthcoming, is designed to automate multi-step work before, during and after conversations, connecting with existing tools and systems. Examples include pre-screening a mortgage applicant and calling back within minutes, reminding patients about visits and offering canceled slots to waitlisted patients, emailing reports, writing to a customer relationship management system or initiating calls. Together, the features move ElevenAgents beyond answering inquiries toward retaining context and completing the work surrounding a conversation.

For employees, Staniszewski previewed ElevenAI, an app that listens to spoken conversations, including in-person meetings, and produces notes, summaries and action items. It can also provide live assistance and pass context between people and agents. ElevenLabs says the app takes meeting notes with participants’ consent and includes notice and consent mechanisms.

Free early access to ElevenAI opened with the announcement. Dictation and meeting notes use Scribe v3, which ElevenLabs describes as its recorded-audio transcription model covering 102 languages; the separate Scribe v3 Live variant is built for low-latency, real-time audio.

Partners, Marketplace and NVIDIA Infrastructure

ElevenLabs reports more than 550 partners across 44 countries, including Google Cloud, IBM, Deloitte, DXC and Genesys. The new Partner Program lets consultancies, systems integrators, software vendors and agencies integrate ElevenAgents into enterprise technology stacks or work with ElevenLabs’ forward-deployed engineers on complex deployments. An alliance with McKinsey and QuantumBlack, AI by McKinsey, pairs the platform with McKinsey’s enterprise-transformation work.

The accompanying Marketplace initially offers a curated catalog of partner-built applications for healthcare, financial services, insurance, education and retail. Enterprises can browse the applications and contact their developers; purchasing through existing ElevenLabs commitments is planned to start in 2027.

ElevenLabs and NVIDIA announced that Nemotron 3.5 Super VL is available in ElevenAgents and that ElevenLabs plans to add 15 MW of NVIDIA Vera Rubin compute capacity on top of its existing Blackwell Ultra systems. The added capacity is intended for large deployments with security or data-residency requirements and to give ElevenLabs researchers access to optimized compute.

The expanded collaboration also covers an on-premises voice agent for Centralna e-Rejestracja, the central appointment system in Poland’s national e-Health platform, with EasyCall supporting delivery. The agent calls patients who only have landlines to remind them about appointments and help them reschedule. ElevenLabs says the central system handles 40 million appointments annually and has no-show rates of 10% to 20%; the deployment uses NVIDIA Confidential Computing to keep citizen data and audio within government infrastructure and protect them during processing.

The Summit package makes ElevenLabs’ enterprise strategy dependent on more than model performance: tuning and Memory draw on data accumulated in live use, Routines connects conversations to business systems, and the partner program and Marketplace create routes into enterprises. The central execution challenge is therefore twofold: moving the previewed and early-access products into broader production use, and progressing Marketplace browsing to purchases through existing ElevenLabs commitments.