Skip to main content

Vocal stem to MIDI

Updated:

Upload a song's vocal stem (vocals only) or the full song, together with the full lyrics, and the system turns the sung melody into notes and puts each word on its note. The notes start at bar 1, on the track that was active when you submitted. Converted notes are labeled with the "Vocal Stem (AI)" source.

The result is never 100% correct. It saves you transcribing from scratch; check it by ear afterwards. Only convert songs you have the right to use. Mouta Studio makes no guarantee about who owns the rights to the result.

What do I need to prepare?

Item Requirements
Audio A vocal stem or a full song in WAV, MP3, FLAC, M4A or MP4; 5 seconds to 6 minutes long; up to 500MB
Full lyrics Required, up to 5,000 characters. One line per phrase gives better results. Write repeated choruses out as many times as they are sung. Leave out tags like [Verse]
Language English, Chinese, Japanese, Korean or "Mixed". Detected from the lyrics automatically; you can change it
Song BPM Optional, a whole number from 40 to 280. If you fill it in, the track tempo is set to it first

Use a vocal stem when you have one. A full song is first separated into vocals in your browser (the first time downloads a model of about 172MB); the result is less precise and should be treated as a rough guide.

How do I convert a song to MIDI?

  1. We recommend first clicking "Palette Track" on the toolbar, so the converted notes land on the Palette Track.
  2. In the sidebar under "Content Source", click the waveform icon ("Vocal to MIDI") to open the "Vocal stem to MIDI" panel.
  3. Click "Choose audio (vocals or full song)". For "Audio type" choose "Auto-detect", "Vocal stem" or "Full song (separate vocals first)".
  4. Paste the full lyrics and check the language and BPM.
  5. If you like, tick "Easier editing: tidy pauses" (pauses inside a line shrink to 0.75 beat and lines are 1 beat apart, so Struct cuts each line into one phrase; timing will differ from the original). Leave it off if you need the timing to match the original exactly.
  6. Click "Start conversion". The panel shows progress (reading audio, separating vocals, uploading, in queue, converting, fetching result). A song usually takes a few minutes.
  7. When it's done, the notes are placed on the track automatically and you see "Placed N notes; removed M notes flagged for deletion".

You can do other things while you wait. If you close the panel or reload and open it again, it keeps checking on the same conversion. Only one conversion can run at a time. Click "Cancel" to stop.

Does Vocal to MIDI upload my audio, and for how long is it kept?

Yes. The conversion runs on our server, so this feature sends audio to it (for other features, see Which features send audio to a server).

  • What is uploaded: the vocal audio. The file you choose is converted to mono WAV in your browser before upload. With "Full song", the vocals are separated in your browser first and only the separated vocals are uploaded, never the backing track. The lyrics, language and BPM are sent along with it.
  • How long it is kept: the uploaded vocal audio and the conversion settings are kept on the server for 7 days, then deleted automatically.
  • Within 7 days: you can use "Re-recognize this line". After 7 days you need to convert the whole song again.
  • Once placed, the notes and lyrics are part of your project and are saved with it.
  • The original-audio comparison ("Playback mode (original vocal)") plays the original file on your computer, not the copy on the server.

Only upload audio you have the right to use.

What should I watch for with Japanese or mixed-language lyrics?

  • Singing is one note per syllable (one per mora in Japanese). When you click "Start conversion", the system first replaces kanji with how they are sung and lists them. Check them in the lyrics box, change any to the correct kana if needed, then click "Start conversion" again.
  • If several languages are detected, the system suggests "Mixed": each word is split into syllables by its own language.
  • Tools such as SUNO often can't sing numbers with several digits, so write numbers out as words.

What are the notes "flagged for deletion"?

Notes the system thinks are most likely noise, breaths or misheard harmonies. They are removed by default when the notes are placed. If too many were removed, click "Use full version" to bring them back. This button only works right after placing, before you make any other edit.

How do I use "Lines to check first"?

After placing, the panel lists the lines that most need attention. Click one to jump to it and select its notes. Common labels: Not matched; Lyrics partly matched; Most words were not heard clearly; Line start may be cut wrong; Fewer notes than syllables; More notes than syllables; Low recognition confidence; Not in the selected language. A line that isn't listed isn't guaranteed to be right, so listen through the whole song anyway.

What if one line came out wrong?

Click "Re-recognize this line" next to it, and the system listens to just that line again. When it finishes you get "Original | Retry": click to switch between them and play to compare. "Revert all to original" puts everything back in one go.

Limits:

  • Only in the same page session in which the notes were placed.
  • The lyrics must have line breaks.
  • Up to 10 lines per song.
  • A line you have edited can no longer be switched.
  • The uploaded vocals stay on the server for 7 days only; after that you need to convert the whole song again.

How do I compare the MIDI with the original song?

Next to the play button is "Playback mode (original vocal)" with four modes. Both the main play button and Struct's play button follow it:

Mode What you hear Good for
Normal (MIDI) MIDI only Checking the melody after editing
Original vocal only Only the original singing for this part Hearing exactly how it was sung
Original, then MIDI Each line sung by the original, then played as MIDI Finding differences line by line, the fastest way to check
Original + MIDI together Original and MIDI at the same time Checking pitch and timing line up
  • In any mode other than Normal, if notes are selected only the selection plays.
  • In "Original, then MIDI" with nothing selected, it goes line by line from the line under the playhead; use "Previous line", "Replay this line" and "Next line" to move.
  • You can adjust the original volume, the MIDI volume when playing together, and the original timing (in milliseconds).
  • The setting lasts for this page session only; after a reload it goes back to Normal.
  • On a different computer, or after clearing browser data, you'll be asked to choose the audio file you originally converted (it checks it is the same file).
  • If you change the tempo (BPM) after placing, the original doesn't change speed, so playback falls back to Normal.

Lyrics are shown on the notes, so you can see which note each word is sung on, where the runs are and where the breaths are. If you're studying how melodies are written, use your own demo or a song you have the right to use.

How do I polish the result?

  1. On the Palette Track, play a line and compare it with the original using "Original, then MIDI".
  2. Copy that line to the Main Track.
  3. No need to fix every note: swap the parts that don't sound good for candidates with "Replace" or "Rewrite" (see Polishing a melody), or fix pitch and length by hand.
  4. Work through it line by line.

Places that often need attention: the first word of a line, repeated notes on the same pitch (may be merged into one long note), runs and slides (may be split into many short notes), and harmonies or echoes.

Do the converted notes count as my own writing?

In your Creative History they count as machine content. The notes were transcribed from audio by AI, and their source is labeled "Vocal Stem (AI)", even if you sang the original yourself (the system can't tell from audio whether a person or an AI is singing).

  • Notes you change by hand after placing are recorded separately as your edits.
  • Parts you swap with "Replace" or "Rewrite" are recorded under that feature's source.
  • Your picks, re-recognitions and version switches are recorded too.
  • The original audio you upload is external material that you supply, and you need the right to use it.

The Creative History is a record, not a ruling on copyright. See what Mouta Studio records.