# What is speaker diarization? Definition + how it works > Speaker diarization is the process of separating an audio stream by speaker, answering who spoke when. Learn how it works and why meeting apps rely on it. Source: https://meetstream.ai/glossary/speaker-diarization ## What is speaker diarization? ### How speaker diarization works A diarization pipeline typically runs in stages. Voice activity detection first strips out silence and non-speech. The remaining audio is cut into short segments, and each segment is converted into a speaker embedding, a numerical fingerprint of the voice. A clustering algorithm then groups segments with similar fingerprints, assigning anonymous labels such as Speaker 1 and Speaker 2 and estimating where one speaker stops and another starts. Modern systems increasingly do this end to end with neural networks, which handle overlapping speech better than classical clustering. Diarization can run on a finished recording or incrementally on a live stream, though streaming diarization is harder because the system cannot look ahead. ### Diarization vs speaker identification Diarization separates voices without knowing who they belong to; the output is 'Speaker 1 said X'. Speaker identification goes further and maps each voice to a named person, either by matching against enrolled voice profiles or, in video meetings, by using platform signals such as active-speaker events and participant metadata. Meeting products usually combine the two so transcripts read 'Priya: X' rather than 'Speaker 1: X'. ### Why diarization matters for meeting data An unattributed transcript is hard to act on. Attribution is what makes talk-time analytics, coaching insights, action-item ownership, and reliable summaries possible. It matters most in multi-speaker settings such as sales calls, interviews, panels, and research sessions, where knowing who asked and who answered changes the meaning of the text. ### The limits, and how meeting platforms avoid them Diarization from a single mixed audio track remains error-prone: short back-channel phrases, similar voices, and crosstalk cause segments to merge or swap. Video conferencing offers a shortcut. When each participant's audio arrives as a separate stream, attribution is essentially exact because each track already belongs to a known participant, and diarization is only needed within a track when multiple people share one microphone in a room. ### Speaker diarization in practice MeetStream handles attribution at the capture layer: bots on Zoom, Google Meet, and Microsoft Teams return transcripts with speaker identification, and separate per-participant audio streams give each voice its own channel, so downstream diarization work is minimal. Details are in the MeetStream docs . See the meeting bot API page to go deeper. ### Frequently asked questions Transcription converts speech to text. Diarization determines who spoke each part. They are separate steps that usually run together, producing a transcript where every utterance carries a speaker label and timestamps. On clean, single-channel audio with a few speakers, modern systems commonly reach diarization error rates in the single digits to low teens. Accuracy falls with overlapping speech, many speakers, and noisy recordings, and improves dramatically when audio is captured per participant. Yes, but with tradeoffs. Streaming diarization must label speakers without seeing future audio, so labels can be revised as more speech arrives. Systems that receive separate audio streams per participant sidestep this problem entirely. ### Related reading ### Put the vocabulary to work One API to join, record, stream, and transcribe meetings on Zoom, Google Meet, and Microsoft Teams. --- Full site index for agents: https://meetstream.ai/llms.txt API contract (OpenAPI 3.1): https://meetstream.ai/openapi.json MCP discovery: https://meetstream.ai/.well-known/mcp