Introduction to Spatial9

What Spatial9 does, who it is for, and how the platform, the engine and the integrations fit together.

Spatial9 is an AI platform that turns stereo audio, stems and existing immersive masters into immersive spatial audio, and delivers the result in open and industry formats such as Eclipsa Audio (IAMF), ADM BWF, binaural and Ambisonics. This page explains what the platform does, who it is designed for, and how the web app, the engine and the developer integrations fit together.

Read this page first if you are new to Spatial9. It gives you the mental model used by every other page in these docs: what you provide, what the system automates, what you still decide, and which entry point (the app, an AI assistant, an agent or the API) matches the way you work.

What Spatial9 does

Spatial9 places each sound in a mix at its own position around the listener, in front, behind, to the sides and above, instead of on the single left-to-right line that stereo allows. The platform recreates the cues the brain uses to locate sound, so the result can be heard on a room of speakers, a soundbar or ordinary headphones through binaural rendering.

The platform performs four kinds of work for you:

  • Source separation. When you supply only a finished stereo master, Spatial9 estimates individual stems such as vocals, drums, bass and other instruments.
  • Spatial arrangement. GravityLLM, the Spatial9 AI model, decides where every source sits, how far away it is, how high it is and how it moves over time.
  • Processing and rendering. AI agents coordinate the processing and rendering steps that turn sources plus positions into immersive audio.
  • Delivery. The system exports the deliverables your workflow needs, from binaural headphone files to ADM BWF masters and Eclipsa Audio for YouTube.

Who Spatial9 is for

Spatial9 is designed for anyone who has finished audio and wants an immersive version without building a dedicated immersive studio. Typical users fall into the following groups.

AudienceTypical goalUsual entry point
Musicians and producersRelease an immersive version of a songWeb app, Spatializer for Music
Labels and publishersConvert a back catalog at scaleREST API, A2A, automation tools
Video creatorsGive a video soundtrack depth and movementSpatializer for Video
Atmos mix engineersPublish an existing Dolby Atmos mix on YouTubeADM to Eclipsa Audio converter
DevelopersAdd spatial audio to an application or agentMCP, A2A, REST API, Agent Skills
Device and broadcast teamsReal-time stereo-to-immersive playbackAcoustic Digital Twin
Students and educatorsLearn immersive productionSpatial9 Academy and Education plans

Design principles

The platform is built on a small set of principles that explain much of its behavior.

  1. Accessibility for creators. Immersive production is available to independent musicians, video creators, labels and students, not only to large studios. A stereo track or a set of stems is enough to start.
  2. AI does the heavy lifting. Separation, spatial arrangement, processing, rendering and multi-format export are labor-intensive tasks that the system performs quickly and consistently.
  3. Humans direct taste and intent. The system proposes; you decide what the mix should feel like and when it is finished. Every move the engine makes can be heard, compared with stereo, edited or rejected.
  4. Open formats and no lock-in. Spatial9 delivers to open and widely supported formats, including ADM, Eclipsa Audio (IAMF), binaural and Ambisonics, depending on the workflow and plan.
  5. Accessibility for listeners. The music experience includes a hearing accessibility profile so playback can adapt to the person listening.

Spatial9 is a member of the Alliance for Open Media, the organization behind IAMF, and debuted music rendered in Eclipsa Audio with Google at CES 2025.

The two lanes of work

Every Spatial9 project divides work between two lanes. Understanding this split helps you know where to spend your attention.

Two lanes: the human lane with brief, judge the source, listen, revise and approve, and the Spatial9 lane with source separation, 3D arrangement, processing and rendering, exports and scale
You set direction and judge results, while Spatial9 automates the heavy lifting.

The human lane

You act as the creative director. The human lane is a repeatable loop of five decisions:

  1. Write the creative brief. Describe the genre, mood, destination and intent. A specific brief such as "intimate acoustic ballad for headphones, vocal close and centered, room ambience gently above" gives the system more to work with than a generic request.
  2. Judge the source. Decide whether the stereo master is clean enough, whether stems are available, and whether problems such as heavy distortion or a very narrow mix will limit the result.
  3. Listen critically. Review on headphones and, where possible, on speakers. Check balance, clarity, translation and whether the space serves the song.
  4. Decide what to revise. Write actionable notes, for example "the vocal feels too far away" or "the hi-hats move too much".
  5. Approve delivery. Check formats, file names and destination specifications before anything is published.

The automation lane

Spatial9 handles source separation when needed, generates the spatial arrangement with GravityLLM, coordinates processing and rendering with AI agents, and produces exports. For catalogs, jobs can be submitted in batches through APIs, with webhooks reporting back when a job finishes.

The production pipeline

A track moves through seven stages from upload to publication. These stages are the same whether you work in the app, through an AI assistant or through the API.

Two-lane pipeline: the production lane from input through analysis, GravityLLM, AI agents, listening, delivery and publish, and the training lane from studio data to model export
The production lane turns a track into deliverables, and the training lane keeps improving the model.
StageWhat happensYour role
1. InputYou provide a stereo master or a set of stemsChoose the input type
2. Analysis and separationThe material is analyzed; stems are estimated if neededSupply clean, lossless sources
3. GravityLLM arrangementAzimuth, elevation, distance and movement are generated per sourceProvide a clear brief
4. RenderingAI agents coordinate processing and renderingNone
5. Quality listeningYou review the resultListen and write revision notes
6. DeliveryFiles are exported in the formats you selectChoose formats per destination
7. PublishFiles are sent to YouTube, a distributor or another destinationApprove and check destination rules

A separate training lane teaches GravityLLM how to make spatial decisions. Studio sessions contribute stems, spatial positioning data and genre metadata; a training database stores 3D coordinates, instrument types, genre classifications and movement patterns; and the trained model is versioned, tested and deployed to inference engines. Because spatial decisions are learned from real examples, the model places an electronic synth differently from a folk guitar. See Spatial inference and GravityLLM for details.

What the engine provides

The music engine combines several systems that respond to the structure and content of a song. The following table summarizes the capabilities documented for the engine.

CapabilityDescription
Movement libraryMore than 1,500 movements built on more than 110 core shapes in 20 families, beat-synced with a per-stem phase
Section-aware stagingNine section profiles, from intro to outro, each with its own field size and height
Harmonic motionKey, mode and chord estimation mapped to subtle spatial behaviors such as field breathing and key-change warps
Lyric choreographyWord-level transcription, 154 built-in words and phrases and 22 spatial actions, each open to your approval
Immersive effects61 effects in nine families, six of them spatially aware versions of traditional tools
Movement from textA plain-language description becomes a parametric 3D path, refined in conversation
Gesture inputHand tracking and full-body pose tracking from a camera turn gestures into movements
Frequency-aware placementPer-stem filtering keeps low-frequency weight stable while upper ranges carry direction
Mixing assistantA conversational assistant that acts on the mix across 27 kinds of actions
Export presetsUp to 33 presets, from stereo and 7.1.4 to ADM BWF, Ambisonics, binaural and Eclipsa Audio

The lead vocal, kick and bass stay anchored by default, so the song keeps its center while the space around it moves. See Spatializer for Music for the full description of these controls.

Products

Spatial9 is organized into the following products. Each has its own page in the Products section of these docs.

ProductInputOutputPage
Spatializer for MusicStereo master or stemsImmersive mix in binaural, ADM BWF, Eclipsa Audio, Ambisonics and moreSpatializer for Music
Spatializer for VideoVideo with its soundtrackImmersive soundtrack, including Eclipsa Audio for YouTubeSpatializer for Video
ADM to Eclipsa Audio converterDolby Atmos ADM BWF masterEclipsa Audio (IAMF) and a YouTube-ready MP4, freeADM to Eclipsa Audio converter
Acoustic Digital Twin (ADT)Live stereo audioReal-time immersive rendering for cars, devices, streaming and broadcastAcoustic Digital Twin
Education and AcademyNoneFree course, classroom studio, accessible guides and certificatesEducation and Academy

Integrations for developers and agents

The same engine is reachable outside the web app through several interfaces. All of them submit the same kind of render work and are subject to the same account limits.

InterfaceAddressUse it when
MCP serverhttps://spatial9.ai/mcpYou want ChatGPT, Claude, Gemini, Cursor or another MCP client to call Spatial9 as a tool
A2A agenthttps://spatial9.ai/a2a (A2A 0.3.0)Another agent or an agent platform delegates spatial audio tasks to Spatial9
REST APIhttps://api.spatializer.spatial9.ai/api/v0.0.1You need direct HTTP control, with tus resumable uploads
Agent SkillsSKILL.md libraryYou want coding agents to learn how to use Spatial9 correctly

The documented limits are 3 concurrent renders, 20 renders per day and 120 A2A tasks per hour. In the A2A interface, messageId acts as the idempotency key, and push notifications carry the X-A2A-Notification-Token header. See Limits, quotas and errors before you build automated pipelines.

Output formats

Depending on the workflow and plan, Spatial9 delivers the following families of output.

  • Eclipsa Audio (IAMF). The open, royalty-free format based on the Alliance for Open Media IAMF specification. YouTube has accepted Eclipsa Audio uploads since January 2025.
  • ADM BWF and ADM XML. Object-based masters in the Audio Definition Model, used for professional delivery workflows including Dolby Atmos.
  • Binaural. A headphone rendering as WAV or MP4 that plays on any pair of headphones.
  • Ambisonics. Scene-based audio (higher-order Ambisonics), used for VR and 360 video.
  • Channel layouts. Stereo, 5.1, 7.1, 7.1.4 and larger layouts on plans that include them.

For input, the platform accepts WAV, MP3, FLAC and AIFF. For best results, use 24-bit WAV at 48 kHz or higher; files up to 96 kHz sample rate are accepted.

Plans at a glance

Music and video features are offered in separate plan families. Format availability depends on the plan.

PlanPrice per monthProjectsFormats
Music Free$01 per monthPreview only, share only
Music Pro$295 per monthADM BWF, ADM XML, Eclipsa Audio, binaural WAV and MP4, Ambisonics HOA
Music Studio$14930 per monthMusic Pro formats plus IAMF and MPEG-H
Music EnterpriseCustomUnlimitedAll formats plus custom

Video plans start with Video YouTuber at $14 per month, and a Creator Bundle combines Music Pro and Video Creator. Current prices and yearly rates are listed on the pricing page.

How these docs are organized

SectionWhat it covers
Getting startedThis introduction, the quickstart, core concepts and choosing a workflow
ProductsHow each product works, what it accepts and what it delivers
Developers and agentsMCP, A2A and REST references, limits, Agent Skills, automation and enterprise pipelines
Formats and deliveryEclipsa Audio, IAMF, Dolby Atmos, ADM BWF, Ambisonics, binaural and publishing
Mixing standardsRules for immersive mixes, stems, upmixing and genre approaches
Science and researchPsychoacoustics, the spatial audio ontology and the research behind the engine
ReferenceThe FAQ and troubleshooting page

Terms such as object, bed, scene, renderer and binaural are defined in Core concepts and in the glossary.

Next steps

Go deeper on the blog