Upmixing stereo vs mixing from stems

When to upmix a finished stereo master, when to work from stems, and how stem separation fits in.

This page explains the three ways to turn existing music into an immersive mix: classic upmixing, AI source separation with placement, and mixing from original stems. It compares what each route can and cannot do, which platforms accept the result, and how stem separation tools fit into a Spatial9 workflow.

It is written for musicians, producers, DJs, creators, educators and labels deciding whether to start from a finished stereo master or from stems.

Three techniques that are often confused

The terms "upmix", "stereo conversion" and "stem mix" are frequently used interchangeably, but they describe three different processes.

Flow diagram of three routes to an immersive mix: a classic upmixer spreading stereo ambience, AI separation of a stereo master into parts placed in 3D, and mixing from original multitracks
Three methods that are often confused.

Classic upmixing

A classic upmixer, such as Dolby Surround or DTS Neural:X built into AV receivers, analyzes a stereo or 5.1 signal. It identifies which parts are correlated between the channels, usually the direct sound, and which are not, usually reverb and ambience. It keeps the direct sound at the front and spreads the ambience to the side, rear and height speakers.

The result can be pleasant, particularly on live recordings with a lot of room sound, but it is not a creative immersive mix: the upmixer never knows which sound is which, so it cannot move a guitar to the left wall or raise backing vocals overhead.

AI source separation and placement

Source separation uses neural networks trained on large collections of songs with known stems to split a finished mix into parts such as vocals, drums, bass and other. Once separated, each part can be placed and moved in 3D like an object in a conventional mix. This is how Spatial9 turns a stereo song into an immersive mix.

Mixing from original stems

The traditional route starts from the session: every vocal, drum microphone, guitar and synth on its own track, or stem groups exported from the session. Each source is placed as an object or in a bed, movement is automated, and reverb and balance are adjusted for the immersive space. Because the sources are clean, nothing leaks between them and every creative decision remains open.

Comparison at a glance

PropertyClassic upmixAI separation and placementMixing from original stems
InputStereo masterStereo masterMultitracks or stem groups
What happensAmbience is extracted and spreadMix is split into parts, each placed in 3DEach source is placed and moved
Individual placementNoYes, by partYes, by track
Quality limitsWider stereo, little true directionSeparation artifacts and shared reverbOnly the mix itself
SpeedReal timeMinutesHours to days
Apple Music Spatial AudioNot acceptedNot acceptedAccepted
YouTube in Eclipsa AudioPossiblePossiblePossible
Best forPlayback enhancementCatalog, lost sessions, previewsNew releases and flagship titles

Both separation and stem mixing place sources individually. The real difference is the cleanliness of the sources being placed.

Limits of a stereo source

A stereo master has discarded information that separation can only estimate. Separated parts are estimates of the original recordings, not the recordings themselves. Good tools hide most of the resulting problems, but careful listening still reveals them.

LimitDescriptionEffect in 3D
BleedParts leak into each other, such as cymbals in the vocal stemLeaked sound moves with the part it is in
Shared reverbThe original reverb is baked into every partParts placed far apart can sound unnatural
Limited categoriesMost models output vocals, drums, bass and other, sometimes piano or guitarTwo guitars playing together usually stay together
Dense, loud mixesDistortion, layered synths and heavy limitingThese separate less cleanly than sparse acoustic mixes

Mixing from original stems avoids all four limits.

Platform acceptance

Platform rules often decide the route more than sound quality does.

  • Apple Music: Apple's delivery guidance for Dolby Atmos states that it does not accept upmixes of a stereo release, or stems separated from a stereo master, as Spatial Audio. A Dolby Atmos mix for Apple Music must come from the original multitracks.
  • Other music services: rules vary and change. Your distributor may ask how a mix was made, so check before you deliver.
  • YouTube: you upload Eclipsa Audio yourself with your video. An immersive version made from a stereo master can be published alongside or instead of the stereo upload, subject to YouTube's normal policies and your rights to the music.
  • Your own channels: websites, apps, installations, live shows and listening sessions have no format gatekeeper.

Decision procedure

Work through the following questions in order and stop at the first one that applies.

  1. If the release is intended for Spatial Audio on Apple Music, use the original multitracks. No other route qualifies.
  2. If the release is new and you have the session, export stems from the session and mix from them, or let Spatial9 place the stems for you. Every platform accepts the result.
  3. If the song is older and no session survives, use AI separation and placement. This is the practical route, particularly for YouTube in Eclipsa Audio.
  4. If you already have stems from a stem splitter, upload those stems rather than the stereo master. This gives you more control over each part.
  5. If you only want to test whether a song suits immersive playback, run a fast stereo conversion first to hear its potential before committing to a full stem mix.
  6. If you only want to enhance playback on a receiver and do not need individual placement, a classic upmix is sufficient.
Decision guide for choosing between AI separation and placement, original multitracks and stereo conversion for catalogue, Apple Music, new releases and previews
Choose by the release and the platform.

How Spatial9 handles each input

Spatial9 accepts either a stereo master or a set of stems.

InputWhat Spatial9 doesResult
Stereo masterSeparates the song into stems, then places each part in 3DImmersive mix of estimated sources
Stems from a splitterAnalyzes each stem, including its bleed, then places itMore control than a stereo upload
Stems from the original sessionSkips separation and places your clean sources directlyAvoids the limits of a stereo source

For each uploaded stem, Spatial9 analyzes the instrument, energy, frequency range, the amount of bleed it carries and its role in the song. GravityLLM, the placement engine, then builds a 3D scene: core elements anchored at the front, harmony instruments spread to the sides, air and ambience in the height layer, and low frequencies kept centered. Stems with more bleed are kept closer to their partners, while clean stems are allowed to travel further. In every case you can preview on headphones, adjust placement and export the formats you need.

Stem separation tools

Spatial9 does not depend on which splitter produced your stems. What matters is how clean the stems are, whether they line up in time, and how many there are. The following lists are a neutral index, not a ranking. Most commercial tools do not publish which model they run.

Online and mobile apps

ToolWhere you use itTypical stems
MoisesWeb, iOS, Android, desktopVocals, drums, bass, guitar, piano, strings, wind, other
Music.aiWeb and developer platformConfigurable modules for vocals, instruments and dialogue
LALAL.AIWeb, desktop, mobileVocals, instrumental, drums, bass, guitars, piano, synth, strings, wind
AudioShakeWeb (AudioShake Indie) and developer platformVocals, instruments, dialogue, music and effects
FadrWeb and desktopVocals, drums, bass, melodies, plus MIDI
Gaudio StudioWebVocals, drums, bass, piano, guitar, other

Separation is also built into DAWs and editors (including Logic Pro Stem Splitter, FL Studio Stem Separation, Ableton Live 12.3 and later, Steinberg SpectraLayers, iZotope RX Music Rebalance and RipX DAW) and into DJ software (including Serato Stems, rekordbox Stems, Traktor Pro 4, VirtualDJ Stems, djay Neural Mix and Engine DJ Stems).

Open models

Separation quality is usually reported as SDR (Signal-to-Distortion Ratio) in decibels on the MUSDB18 benchmark, which contains 150 songs with vocals, drums, bass and other stems. Higher is better, and every additional 3 dB roughly halves the error energy.

ModelYearMade byFamilyReported average SDR
Open-Unmix2019Inria and SonySpectrogram maskabout 5.3 dB
Spleeter2019DeezerSpectrogram maskabout 5.9 dB
Hybrid Demucs (v3)2021Meta AIHybridabout 7.7 dB
KUIELab-MDX-Net2021Korea UniversitySpectrogram maskabout 7.5 dB
HT Demucs (v4)2022Meta AIHybrid plus transformerabout 9.0 to 9.2 dB
BS-RoFormer2023ByteDanceBand-splitabout 9.8 dB (12.0 dB with extra data)
SCNet2024Academic researchBand-splitabout 9.0 dB
SAM Audio2025Meta AIPromptedNot reported on fixed 4-stem SDR

Model families and typical artifacts

FamilyExamplesStrengthArtifact to listen for
Spectrogram maskSpleeter, Open-Unmix, MDX-NetFast and lightHollow or "underwater" sound from reused phase
WaveformWave-U-Net, Demucs v1 and v2Crisp transientsWeaker high-frequency detail, occasional noise
HybridHybrid Demucs, HT DemucsBalanced all-rounder using long musical contextNo specific artifact noted
Band-splitBS-RoFormer, Mel-RoFormer, SCNetCleanest vocals, least bleedSlow without a good graphics card
PromptedAudioSep, SAM AudioExtracts any described soundCan invent small details

Ultimate Vocal Remover (UVR) is a free desktop app that bundles many of these open models. SAM Audio lets you describe the target with text, by clicking on an object in a video, or by marking a time span, and returns the target sound plus the residual mix. Use prompted models for specific targets alongside a classic stem split.

Stem count

The number and type of stems matters more for 3D mixing than a fraction of a decibel, because every extra stem is another object to place.

  • Four stems (vocals, drums, bass, other) are enough for a convincing immersive mix.
  • Six stems (adding guitar and piano) let you separate harmony instruments to opposite sides.
  • Specialized stems such as lead versus backing vocal, reverb or crowd rise naturally into the height layer.
  • Prompted extraction can split the busy "other" stem further, which is usually the stem that benefits most.

Workflow: from a stereo master

  1. Start from a lossless master, not a streaming rip or MP3.
  2. Upload the stereo master to Spatial9.
  3. Spatial9 separates the song into stems and places each part in 3D.
  4. Preview the result on headphones.
  5. Adjust placement where bleed or shared reverb is audible.
  6. Export the formats your destination accepts, keeping in mind that Apple Music does not accept this result as Spatial Audio.

Workflow: from separated or session stems

  1. Split the song with the tool of your choice. If you can choose the model, a recent band-split or hybrid model (RoFormer or HT Demucs) gives the cleanest result for 3D. Choose the highest number of stems available.
  2. Export every stem as WAV, 24-bit, at 44.1 or 48 kHz. Avoid MP3 stems, because compression adds its own artifacts on top of separation artifacts.
  3. Make every stem start at the same point and have the same length.
  4. Name the files clearly so instruments are recognized immediately.
  5. Play all stems together once and confirm that the sum sounds like the original song.
  6. Upload all stems together to Spatial9.
  7. Review the placement in the 3D view and move any object you want.
  8. Keep vocal, kick, snare and bass anchored, and lift reverb, pads, backing vocals and cymbals slightly above the listener.
  9. Listen on both headphones and speakers, then export.

For binaural delivery, use the cleanest stems possible, because headphones reveal bleed the most. For ADM BWF and 7.1.4, more stems are better, because each becomes its own object or bed channel.

Troubleshooting

SymptomLikely causeRemedy
A ghost of one instrument comes from the wrong directionBleed between separated stemsUse a cleaner model or keep the affected stems closer together
Soloed stems sound hollow or underwaterMask-based model reused the mix phaseKeep all stems in the mix rather than muting some
Drums sound soft after splittingOlder spectrogram model smeared transientsRe-split with a Demucs or RoFormer based model
Reverb is split unpredictablyReverb belongs to every instrument at onceLift the reverb that lands in "other" into the height layer
Widely spaced parts sound unnaturalShared reverb baked into every partReduce the spacing, or mix from original stems
Stems drift out of timeStems have different start points or lengthsRe-export with the same start point and length
Bleed audible only on headphonesHeadphones reveal bleed more than speakersCheck on both, and prefer band-split models for binaural
Distributor rejects the mixPlatform rules on upmixes or separated stemsDeliver a mix made from the original multitracks

Next steps

Go deeper on the blog