Plenio Music Production System
Plenio Music Production System: song writing with local LLMs, YuE2 and MiniMax Music 3 generation, editable scores, covers, stems, mastering, release export and the Plenio Player for ComfyUI - free and local.
Nodes (37)
Turns a writer's plan into real notes, or leaves your score alone
It Only Takes the Fix If It Sounds Like What Was Sung
Four Rules Decide Whether the Fix Survives
One loader for the two models nobody else in ComfyUI wants to load
YuE2 Skipped a Verse? Best Take Renders Twice and Keeps the One That Actually Sings
Hand the writer model the song plan, not the notes
Your Cover Is About to Sing the ASR's Typo. Ask a Local LLM Which Word It Misheard
Compose Writing Prompt Turns Your Brief Into Instructions a Small LLM Can Actually Follow
Compose Sung Check Builds the Question — It Doesn't Answer It
Pick the New Style, Keep the Melody, and Actually Decide What Happens to the Vocals
Plenio's Creativity Slider Is Just a Dial — This Node Is the Gearbox
One Wire, and the Whole Workflow Knows Which Music Model It's Talking To
Manual Bands, or Let It Fit a Gentle Tone Match to Your Mix
Files With Tags and Cover Art, Plus a Record of How the Song Was Made
The syllable bouncer between your words and the melody
The Experimental Stage the Author Leaves Switched Off
What HQ Mastering Actually Buys You
Delete the Top Octave and Have a Model Grow a New One
Tame the Shimmer AI Leaves at the Edge of the Image
A GGUF that loads for one answer and then gets off your GPU
-14 LUFS, -1 dBTP, Measured Before and After
When the model's sections and your lyrics disagree
Your Local LLM Won't Follow Your Format — Parse Song Draft Makes It
Refine (48 kHz) invents the top octave — and tells you exactly what it invented
Transpose, Trim and De-Vocal a Song by Editing Its Score, Not by Re-Rolling
A Seed Node That Shows You the Seed You Just Heard
Four stems and the leftover everyone else throws away
Nine Fields Between 'Indie Pop' and a Song You'll Actually Keep
The One Place You Can See — and Overrule — What the Model Is About to Be Told
The mixer that only changes what you change
The pink line that shows you every note the transcription got wrong
Run This First When Anything Is Red
Get the Words Out of a Recording, and Check What a Take Actually Sang
Transcribe Score Is How You Turn a Recording You Own Into Something the Model Can Play With
'Instrumental' Is a Request, Not a Promise — Measure the Takes Instead
One dropdown that decides which model writes your song
Plenio is a one-of-a-kind extension for ComfyUI - completely free and completely local - with three things that set it apart:
- Songs on autopilot. Any song you can imagine - and any kind of cover - made with YuE2 from the first idea to a mastered, release-ready track, automatically. One brief can become a whole series of finished songs.
- Every note under your control. Or shape a song exactly the way you want it: the lyrics, the melody, every note and chord that is played - in a DAW-like editor with real notation.
- A player made for these songs. The Plenio Player is tuned to everything Plenio makes: the lyrics light up as they are sung, the sheet music follows the music, visuals move with it, and music videos are made on your graphics card.
And then there is the party - what makes Plenio unique. At a party or any event, every guest opens the player on their own phone or tablet: they see the live playlist and, if you allow it, change it. And it doesn't stop there - every guest can make a song of their own on the fly, through your studio, and add it to the playlist. Huge fun at any get-together.
<p align="center"> <a href="https://youtu.be/myiZawtsja4"><img src="assets/branding/1.5.0/spot-your-party.jpg" alt="Watch the spot: Plenio - Your idea. Your song. Your party. Songs on autopilot, every note under your control, the party joins in, guests make songs on the fly - 54 seconds on YouTube" width="78%" /></a> <br /><sub>▶ <a href="https://youtu.be/myiZawtsja4"><b>Your idea. Your song. Your party.</b></a> - Plenio in 54 seconds · ▶ <a href="https://youtu.be/XpNpks9ZCgE"><b>Your idea. Your song. Your control.</b></a> - the first spot</sub> </p>Everything runs on your own machine, inside ComfyUI's own nodes: no cloud service, no account, no API key, no extra Python packages. Before a single note is rendered, the Song Sheet shows you the title, style, lyrics and score the model will receive - and you can change all of it. Plenio costs nothing and its code is Apache 2.0; saved workflows and release records keep working across every 1.x version.
🎧 Listen first
▶ Songs made with Plenio, as videos - each made in ComfyUI with Plenio and turned into a music video by the Plenio Player (its visuals, the lyrics as they are sung):
<table> <tr><td align="center" width="33%"><a href="https://youtu.be/hPq9tUjTzr0"><img src="https://i.ytimg.com/vi/hPq9tUjTzr0/mqdefault.jpg" alt="Restrained Driving Atmosphere - Progressive Trance, a song made with Plenio, as a Plenio Player video" width="100%" /></a><br /><b>Restrained Driving Atmosphere</b><br /><sub>Progressive Trance</sub></td><td align="center" width="33%"><a href="https://youtu.be/hAaLnEOe6-g"><img src="https://i.ytimg.com/vi/hAaLnEOe6-g/mqdefault.jpg" alt="Hypnotic Rolling Progression - Progressive Trance, a song made with Plenio, as a Plenio Player video" width="100%" /></a><br /><b>Hypnotic Rolling Progression</b><br /><sub>Progressive Trance</sub></td><td align="center" width="33%"><a href="https://youtu.be/VcDpDqVAz3g"><img src="https://i.ytimg.com/vi/VcDpDqVAz3g/mqdefault.jpg" alt="Window Open Low - Smooth Jazz, a song made with Plenio, as a Plenio Player video" width="100%" /></a><br /><b>Window Open Low</b><br /><sub>Smooth Jazz</sub></td></tr> <tr><td align="center" width="33%"><a href="https://youtu.be/UoQnC7ceOl8"><img src="https://i.ytimg.com/vi/UoQnC7ceOl8/mqdefault.jpg" alt="Chrome Heartbeat City Glow - Synth-Pop, a song made with Plenio, as a Plenio Player video" width="100%" /></a><br /><b>Chrome Heartbeat City Glow</b><br /><sub>Synth-Pop</sub></td><td align="center" width="33%"><a href="https://youtu.be/r-X1GWI-BR0"><img src="https://i.ytimg.com/vi/r-X1GWI-BR0/mqdefault.jpg" alt="The Brass Floor - Swing / Big Band, a song made with Plenio, as a Plenio Player video" width="100%" /></a><br /><b>The Brass Floor</b><br /><sub>Swing / Big Band</sub></td><td align="center" width="33%"><a href="https://youtu.be/4A_jQsZj8B4"><img src="https://i.ytimg.com/vi/4A_jQsZj8B4/mqdefault.jpg" alt="Lonely Quiet Ascent - Solo Piano, a song made with Plenio, as a Plenio Player video" width="100%" /></a><br /><b>Lonely Quiet Ascent</b><br /><sub>Solo Piano</sub></td></tr> </table>🎧 The demo page - Plenio in 30 seconds, twelve genres with sound, the song videos and more than seventy songs and covers to play, each with everything the model received.
✨ What Plenio does
<p align="center"> <img src="assets/branding/readme/pipeline.png" alt="From one sentence to a finished song and everyone who hears it: 1 Brief - start from one of 250 genre templates or bring your own lyrics; 2 Write - a local LLM writes title, style and lyrics; 3 Song Sheet - see and edit exactly what the music model will get; 4 Score - melody and chords as real notation, edited like a DAW or played in; 5 Render - YuE2 or MiniMax Music 3 sings it, Best Take keeps the take that sings your words; 6 Master - Audio HQ, a tone match, -14 LUFS with a true-peak limiter, stems if you like; 7 Release - FLAC, MP3, tags, cover art, timed lyrics, sheet music and the whole project inside. And then: the Plenio Player, party mode, videos, the Song API, and back in ComfyUI by dropping the FLAC" width="100%" /> </p>| | | |---|---| | Write | A Song Brief or Cover Brief with 250 genre templates in 30 families - choosing one fills every field, and every field is a list with room for your own value; a local language model writes title, style and lyrics - Gemma 4 12B, chosen for your graphics card, or any GGUF, ComfyUI's text models, LM Studio, Ollama, llama.cpp, vLLM or Jan - or you bring your own lyrics, sung as written. A creativity slider goes from steady to adventurous. | | See and change everything | The Song Sheet shows exactly what the music model gets - title, style, lyrics, score - with the exact token budget, counted by the model's own tokenizer. Your edits are never silently overwritten. | | Compose | A real score editor: notation, piano roll, chord lane, lyrics on their notes, a MIDI keyboard, arranging like in a DAW, MIDI and MusicXML in and out, sheet music as PDF - or write the whole melody yourself (YuE2 · DAW). | | Perform | YuE2 for songs, covers and your own melody - with up to four LoRAs -, MiniMax Music 3 for songs. Lyrics fidelity renders a second or third take and keeps the one that sings your words best. | | Cover | Any recording becomes a new version: its score read by SheetSage2, its words heard by Qwen3-ASR, new lyrics fitted to its melody. | | Polish | Audio HQ (stereo cleanup, UniverSR regenerating the highs of a dull take), a tone match on the curve, -14 LUFS / -1 dBTP with a true-peak limiter, stems with a mixer. | | Release | FLAC, MP3 or WAV with tags and cover art (FLUX.2 Klein), lyrics subtitles timed by listening, the sheet music as PDF, a page per song with the full lyrics to copy - and the whole project inside the FLAC: drop it on ComfyUI and you are back in its workflow. | | Listen and share | The Plenio Player: visuals, the lyrics as they are sung, Live Play and party mode, music videos, one-file players to send - and the Song API for your own programs. |
🎛️ In ComfyUI
<p align="center"> <img src="assets/branding/readme/bento-comfyui.jpg" alt="In ComfyUI - a whole studio in your graph: the Song Sheet (title, style, lyrics and score exactly as the model gets them), Master (a tone match over the song's spectrum, -14 LUFS), Stems (vocals, drums, bass, other in a mixer), a real score editor (piano roll, notation, chords, the original recording under the notes for a cover with its sung pitch in pink), LoRAs for YuE2 (the node's summary: 1 of 1 LoRA applied, 112 weights for the plan), lyrics heard and corrected on a Song Sheet, and Audio HQ (UniverSR regenerating the highs)" width="100%" /> </p>Six ready-made templates in ComfyUI's template browser, each one clear path from left to right in numbered sections:
| Template | For | |---|---| | 0 · System Check | versions, GPUs, which model files each template still needs, and a hardware table with your row marked | | 1 · YuE2 · Song | new songs with YuE2 - sung, with sparse vocals or instrumental - with an editable score (guide) | | 2 · YuE2 · Cover | a new version of a recording you own or may use: instrumental, original or new lyrics (guide) | | 3 · MiniMax · Song | new songs with MiniMax Music 3 and its structured caption (guide) | | 4 · Enhance & Master | Audio HQ, EQ, loudness and a release export for a file you already have - no music model, runs on the CPU (guide) | | 5 · YuE2 · DAW | compose the score yourself: piano roll, chord symbols, a MIDI keyboard - YuE2 sings exactly what you approved (guide) |
Two ways to work, chosen first in the brief. New song every run turns one brief into a whole series - set the number of runs, press Run once, and every run writes and renders a different song. One song, stop to review is for the song you want to get right: the run stops at the Song Sheets, you check or edit the text and the score, approve, and every later run is a new take of exactly that song. All six templates also run as a simple form in ComfyUI's App mode.
<table> <tr> <td width="58%"><img src="assets/branding/readme/score-midi.webp" alt="Playing a counter-line in with a MIDI keyboard in Song Sheet · DAW: the notes appear in the piano roll while the score plays, over the notation with the lyrics" width="100%" /></td> <td width="42%"><b>A real score editor.</b> YuE2's score opens as notation, piano roll and ABC text, with playback. Draw notes, set chord symbols, arrange sections and bars like in a DAW, play a melody in with a <b>MIDI keyboard</b>, hear every track in its own sound, export <b>MIDI, MusicXML and PDF</b>. For a cover the original recording runs under the notes, with the sung pitch drawn over them - so a wrong note shows at a glance. <a href="docs/user/concepts/score-editor.md">Score editor guide</a></td> </tr> <tr> <td width="58%"><img src="assets/branding/readme/loras.webp" alt="The YuE2 LoRAs node: a LoRA chosen in the first slot, and after the run its summary - 1 of 1 LoRA(s) applied, 112 weights for the plan" width="72%" /></td> <td width="42%"><b>LoRAs for YuE2.</b> Up to four, each with its strength. The node reads from the file whether a LoRA shapes YuE2's <i>plan</i> (structure, melody, genre) or its <i>sound</i>, applies it there, and reads m-a-p's original layout as well as ComfyUI's. A file that does not fit is left out and named - the run goes on. Empty, YuE2 runs as loaded. <a href="docs/user/concepts/loras.md">LoRA guide</a></td> </tr> </table>- Covers from the actual music. SheetSage2 reads the score out of your recording and keeps its beat grid. Qwen3-ASR transcribes the sung words - from the recording or its vocal stem, whichever it hears more surely -, an aligner times them, and Plenio places them into the score's sections. Choose instrumental, original lyrics or new lyrics written to the phrasing of the original.
- Lyrics you can trust. Export times the lyrics by listening (
.srt, whole lines and note by note, as written and as sung) and Enhance & Master can stop at a Song Sheet with the words as heard, so a misheard one is fixed before the release. - Finishing built in. Every song template ends in Plenio · Master: Audio HQ, a gentle tone match, compression and a true-peak limiter to -14 LUFS / -1 dBTP. Stems splits a song into vocals, drums, bass and other and mixes them back with a residual that keeps a neutral mix exact (Audio HQ, Stems, Mastering).
- A release, not just a file. FLAC 24-bit, MP3 V0 or WAV with tags filled from the brief (
Genre: {genre},{lyrics}…) and cover art; the unmastered take; the sheet music as PDF; the song's page as HTML; and a release record of the documents, seeds, settings, loudness, model licences and how the song was made - inside the FLAC too. File › Continue a Plenio song… (or dropping the FLAC) opens the song in the workflow it was made with (Continue a song). - Your own language models. The Local LLM node runs any GGUF in a llama.cpp server that is gone after the draft - the GPU is free again for the music - or asks a running LM Studio, Ollama, llama.cpp, vLLM or Jan (Local LLMs).
- Creative modes (experimental): thirteen modes from sterile to fantasy let the writer plan every section's chords and instrument line; Plenio writes and checks every note (guide).
- Native ComfyUI all the way. Generation, loaders and samplers are ComfyUI's own; Plenio adds 35 nodes where ComfyUI has nothing equivalent, each explained in a tooltip, and ComfyUI manages memory and offers missing model downloads.
▶️ The Plenio Player
<p align="center"> <img src="assets/branding/readme/bento-player.jpg" alt="The Plenio Player - your songs deserve a stage: visuals that move with the music (99, with Plenio Drop presets after MilkDrop and Plenio Nova scenes worked out for every pixel - here a black hole), on every screen (phone, tablet, the party's big screen), party mode (guests order songs and react, live on the big screen), every song on one page (the full lyrics to copy, the prompts, how it was made), songs as videos (karaoke lyrics, notation, 4K or upright), your look (eleven fonts, eleven effects) and share as a player (one HTML file)" width="100%" /> </p>A program of its own: it runs without ComfyUI, opens at http://127.0.0.1:8765/, and finds every song Export Release wrote. Plenio Player beside Run in ComfyUI opens it; or double-click Plenio Player.bat (./plenio_player.sh on macOS and Linux).
- The lyrics as they are sung - lit up syllable by syllable, as written or as the take really sings them, and as full lyrics to copy with their sections. The sheet music follows the music, note by note.
- 99 visuals - 25 classics, 51 Plenio Drop presets after Winamp's MilkDrop and 22 Plenio Nova scenes the graphics card works out for every pixel (a black hole, a galaxy, northern lights, the Mandelbulb, liquid chrome), all moving with the music, plus one made up fresh each time - and only the ones a device draws smoothly are offered. Write your own as a small JSON file of formulas (guide).
- Find anything - search titles, lyrics and briefs, or
genre:jazz bpm:>110 key:Am; filters, saved filters, tags of your own, smart lists, playlists, crossfades and a sleep timer - quick with thousands of songs. - A page per song - its lyrics, notation, sheet music, every field of the brief, how it was made (when, how long, on which graphics card, with which lyrics fidelity), your stars and the measured ones, its files and its other takes.
- Make songs from the player - presets for the whole form, up to four takes at once, users who listen, make songs or help as admins, and new songs released after their maker heard them or an admin approved them; the player starts ComfyUI in the background, the way you last started it.
- Songs as videos - an MP4 of the visual with karaoke lyrics and the notation, Full HD, 4K, square or upright for Shorts, from Low to Best or a bitrate of your own, made on your graphics card faster than the song lasts.
- Share as a player - one HTML file with the songs you choose: anyone double-clicks it and listens, with the lyrics and the visuals. No install, no server, no account.
- On every screen - phone, tablet and the big screen, with Add to Home screen; In your network opens the whole player on another device at home.
Guide: Plenio Player.
🆕 New in 1.5
<table> <tr> <td width="50%"><img src="assets/branding/1.5.0/brief-template.jpg" alt="The Song Brief in ComfyUI with its genre list open: type your own at the top, then every genre the 250 templates know - acid house, afro house, afrobeats, alpine folk, alternative rock and more; the other fields show the chosen template's values" width="100%" /></td> <td width="50%"><img src="assets/branding/1.5.0/brief-own-lyrics.jpg" alt="The Song Brief with lyrics set to my own, sung as written below, and a verse and a chorus typed into the lyrics field" width="100%" /></td> </tr> </table>- Your own lyrics, sung as written - choose my own in the Song Brief and YuE2 sings your words exactly; the writer adds only the style, the cover-art prompt and a title taken from your words. Or give an idea, and it writes the lyrics from it.
- Templates you can see - choosing one of 250 templates fills the brief's fields; every field is a list of what the templates know, and ✎ type your own … takes anything else. Another template replaces what a template put there and keeps what you changed.
- Creativity up to 200 - 100, the bold setting that sounded best, is the new default; above it the writer and YuE2 dare more. Up to 100 every value means what it always did.
- Freer covers - original notes leaves out notes of the instrument line and the chords, down to about a quarter; nothing new is written, and a sung melody keeps every note, so its words stay sung.
- Titles from the lyrics, not from the genre - and 11 new templates: birthday songs, a wedding first dance, a carnival song, party Schlager, a Liedermacher song, pop rock, melodic trap, Latin pop, J-rock and Italian pop.
- Section tags of your own - the eight sections YuE2 learned as buttons, more that Plenio fits to its plan, and your own tags (
[Violin Rise],[Choir]…) kept for every song: with words they are sung, without words they become an instrumental part. - A song form that remembers - the player's Make a song opens with your last song's values and settings, and a maker may release at once. And every LLM answer may run to 16 384 tokens: room for thinking models.
Every change, in detail: CHANGELOG.
🧩 Under the hood
<p align="center"> <img src="assets/branding/readme/architecture.png" alt="Under the hood - plain parts, no magic: inside ComfyUI the custom node package with 35 nodes on the V3 node API, ComfyUI's native models, exact budgets from the model's own tokenizer, workers for Qwen3-ASR and llama.cpp, and the Song API with OpenAPI 3.1; the release as files - FLAC, MP3, WAV with the project in a FLAC block, the .plenio.json record with SHA-256 hashes, seeds and how the song was made, timed .srt lyrics, the song's .html page and .pdf sheet music; the Plenio Player as a separate standard-library Python program with a Vue page, WebGL2 visuals, videos encoded by the browser and muxed with PyAV, a rate-limited party server and the ComfyUI launcher" width="100%" /> </p>For the curious and the people who want to build on it:
- Nothing hidden from the model, nothing hidden from you. Every document that conditions the music passes through a Song Sheet as automatic, edited or manual; manual text is never replaced, and a draft that changes under an edit stops the run instead of guessing. Budgets are exact: YuE2's shared 24 576-token context and MiniMax Music 3's 5 000-token prompt are counted with the loaded model's own tokenizer.
- ComfyUI-native. Plenio's nodes use ComfyUI's V3 node API; the music, cover-art and writer models are ComfyUI's own loaders and samplers, so ComfyUI does the memory management, the offloading and the missing-model downloads. Plenio installs no Python packages.
- A record you can read. Every export writes
<name>.plenio.json- the documents with SHA-256 hashes, the executed prompt and the workflow (secrets redacted), the seeds, every report, the measured loudness (BS.1770-4, true peak, LRA), the model licences and how the song was made - validated against a JSON schema and embedded in the FLAC as anAPPLICATIONblock. Drop the FLAC on ComfyUI: the workflow, the seeds and the sheets are back. - The Song API.
/plenio/api/v1on your running ComfyUI makes songs from a template's fields - OpenAPI 3.1, idempotency keys, long-polling with?wait, file downloads (guide):
curl -X POST http://127.0.0.1:8188/plenio/api/v1/jobs -H "Content-Type: application/json" \
-d '{"template": "yue2-song",
"fields": {"genre": "synthwave", "description": "a night drive through a rainy city", "length": "short (about 1:30)"},
"client": {"name": "my-script"}}'
curl "http://127.0.0.1:8188/plenio/api/v1/jobs/<id>?wait=30" # answers the moment something changes
- LoRAs, joined exactly. ComfyUI's YuE2 fuses q/k/v and gate/up into one projection each; a LoRA trained on the separate ones is joined block-diagonally -
down = [A_q; A_k; A_v],up = diag(B_q, B_k, B_v)- so thatup · downis exactly the stacked deltas (plenio/comfy/loras.py). - The player is plain. A Python standard-library HTTP server and a Vue page: it reads the records, serves only the files a record lists, renders the song's page, muxes the browser's video with PyAV and runs a separate, rate-limited server for the party's phones behind a random 96-bit path. What it starts, writes and opens is listed in SECURITY.md.
- Checked. Over 2 700 tests - unit, contract tests against ComfyUI in-process, host tests with real ComfyUI servers, frontend tests - run in CI on Ubuntu and Windows, with mypy strict and ruff. Architecture · Extending Plenio · Testing
Built for different computers
The 0 · System Check template reads your GPU and marks your row. Nothing is switched automatically; you choose the model files in the loaders.
| GPU memory | YuE2 | MiniMax Music 3 | Cover Art (FLUX.2 Klein 4B) |
|---|---|---|---|
| below 8 GB | only with heavy offloading (the int8 model alone is 4 GB): very slow, keep songs short | only with heavy offloading: very slow | not practical |
| 8-12 GB | int8 checkpoint (template default); keep songs short | int8 DiT minimax_music3_dit_int8_convrot (2.5 GB) and tiled decode | flux-2-klein-4b-fp8 with the text encoder qwen_3_4b_fp4_flux2 |
| 12-16 GB | int8 checkpoint (template default) | the defaults may offload; the int8 DiT is the safer choice | fp8 model and fp4 text encoder |
| 16-24 GB | int8 checkpoint | template defaults (fp16 DiT, int8 text encoder) | template defaults (bf16) |
| 24 GB and more | the bf16 checkpoint yue2_3b_bf16 (7.8 GB) is possible; int8 stays the faster default | template defaults | template defaults |
Measured on a 16 GB RTX 5060 Ti: a 1:44 instrumental - writer, plan, take, master and export, models loaded fresh - in 2½ minutes. The other rows come from model sizes and the predecessor toolkit's ratings. 4 · Enhance & Master needs no GPU. See Models and downloads for every file, folder and size.
Installation
Requires ComfyUI 0.37.0 or newer (tested with 0.41.0); it provides the native YuE2, SheetSage2, MiniMax Music 3, FLUX.2 and text-generation nodes Plenio builds on.
ComfyUI Manager: open Manager → Custom Nodes Manager, search for Plenio Music Production System and install it. Restart ComfyUI.
Comfy CLI:
comfy node install comfyui-plenio-music
By hand:
cd ComfyUI/custom_nodes
git clone https://github.com/jplenio/Plenio-Music-Production-System
Restart ComfyUI, open 0 · System Check from the template browser and run it. Plenio installs no Python packages. One feature is optional and tells you the command when you use it: python -m pip install faster-whisper for covers with lyrics. Model files come through ComfyUI's missing-model dialog when you open a template, or by hand. The writer, Gemma 4 12B, is a GGUF file run by llama.cpp: install llama.cpp (winget install llama.cpp, brew install llama.cpp), and the first song uses the one you have or downloads the one for your graphics card - Q6_K from 16 GB, a QAT Q4 below (details). A YuE2 finetune in ComfyUI's format goes into models/checkpoints and is chosen under checkpoint in the model block.
Watch the tutorials
▶ All tutorials as a YouTube playlist - one narrated video for every template, the creative modes, the Plenio Player, party songs, the Song API and LoRAs (English, 2 to 18 minutes, with chapters), recorded in ComfyUI with the real models: every song you hear in them was made right there.
| | Tutorial | What you will see |
|:---:|---|---|
| <a href="https://youtu.be/v38t0bFqu5Q"><img src="assets/branding/1.5.0/tutorial-0-system-check.jpg" alt="Tutorial 0 · System Check" width="180" /></a> | 0 · System Check | Is your ComfyUI ready? Versions, the GPU, the model files every template needs and the hardware table with your machine's row. |
| <a href="https://youtu.be/PdL7mCKEE1k"><img src="assets/branding/1.5.0/tutorial-1-yue2-song.jpg" alt="Tutorial 1 · YuE2 · Song" width="180" /></a> | 1 · YuE2 · Song | From a brief to a finished song - as a series or one song with review stops - and a tour of the score editor: notes, lyrics, playback, sounds, arranging, recording with a MIDI keyboard, the files. |
| <a href="https://youtu.be/XFkgFgvImzM"><img src="assets/branding/1.5.0/tutorial-2-yue2-cover.jpg" alt="Tutorial 2 · YuE2 · Cover" width="180" /></a> | 2 · YuE2 · Cover | A recording becomes a new version. The original plays under the notes (waveform, A/B), a copied chorus sings its words again, and the sheet music goes out as files. |
| <a href="https://youtu.be/rptsvP0yYio"><img src="assets/branding/1.5.0/tutorial-3-minimax-song.jpg" alt="Tutorial 3 · MiniMax · Song" width="180" /></a> | 3 · MiniMax · Song | Songs with MiniMax Music 3: the caption, the lyrics and the 5,000-token budget, checked before anything is rendered. |
| <a href="https://youtu.be/3bBbOivHvzc"><img src="assets/branding/1.5.0/tutorial-4-enhance-master.jpg" alt="Tutorial 4 · Enhance & Master" width="180" /></a> | 4 · Enhance & Master | Master any recording without a music model: Audio HQ, a warm tone match, measured loudness and the release export - your own sound - and the lyrics of a sung recording, corrected before the release. |
| <a href="https://youtu.be/K1Jr_JpkCUg"><img src="assets/branding/1.5.0/tutorial-5-yue2-daw.jpg" alt="Tutorial 5 · YuE2 · DAW" width="180" /></a> | 5 · YuE2 · DAW | Compose it yourself: the words first, then the music - draw the notes, import a MIDI sketch or play it in with a MIDI keyboard - and YuE2 sings your melody. |
| <a href="https://youtu.be/JTlRvyGssfo"><img src="assets/branding/1.5.0/tutorial-6-yue2-song-creative.jpg" alt="Tutorial 6 · YuE2 · Song · Creative modes" width="180" /></a> | 6 · YuE2 · Song · Creative modes (experimental) | The writer model plans the arrangement, Plenio writes the notes: a dramatic song, its arranged score, the rendered song - and another arrangement from the arrangement seed. |
| <a href="https://youtu.be/5bPU2-coElw"><img src="assets/branding/1.5.0/tutorial-7-yue2-cover-creative.jpg" alt="Tutorial 7 · YuE2 · Cover · Creative modes" width="180" /></a> | 7 · YuE2 · Cover · Creative modes (experimental) | A recording re-arranged for a full ensemble, with new lyrics that keep its story - song flow closeness and lyrics closeness, A/B against the original. |
| <a href="https://youtu.be/FkWj-3P99PM"><img src="assets/branding/1.5.0/tutorial-8-player.jpg" alt="Tutorial 8 · Plenio Player" width="180" /></a> | 8 · Plenio Player | Your songs in the browser, on the phone and on the party's big screen: search, a page per song with the full lyrics and its stars, the lyrics lit up as they are sung, the visuals with Plenio Nova, Live Play with the guests' reactions, videos - and back to ComfyUI. |
| <a href="https://youtu.be/2GBx2xUOnPw"><img src="assets/branding/1.5.0/tutorial-9-party-songs.jpg" alt="Tutorial 9 · Party songs" width="180" /></a> | 9 · Party songs | Songs made from the player, no workflow to open: presets, takes, ComfyUI started for you - and the guests ordering songs on their phones, who made it and at which party, their reactions kept for every song. |
| <a href="https://youtu.be/5vdi3ypvIuw"><img src="assets/branding/1.5.0/tutorial-10-song-api.jpg" alt="Tutorial 10 · Song API" width="180" /></a> | 10 · Song API | Songs from your own programs: one POST, the job followed with ?wait, the files, the song played - and the examples in Python, JavaScript and the shell. |
| <a href="https://youtu.be/o7NtC3U2pEg"><img src="assets/branding/1.5.0/tutorial-11-yue2-loras.jpg" alt="Tutorial 11 · YuE2 LoRAs" width="180" /></a> | 11 · YuE2 LoRAs | The LoRA node under the music model: the two halves a LoRA shapes, a LoRA chosen with its strength, an instrumental made with it, and what the node says after the run. |
▶ Your idea. Your song. Your party. - the spot (54 s) · ▶ Your idea. Your song. Your control. - the first spot (54 s)
Documentation
- Users: Getting started · YuE2 Song · YuE2 Cover · YuE2 DAW · MiniMax Song · Enhance & Master · Song Sheet · Continue a song · Brief templates · Score editor · Stems · Refine (48 kHz) · Instrumental · Mastering · Plenio Player · Plenio Drop presets · Tags and subtitles · Seeds · App mode · Local LLMs · LoRAs for YuE2 · Models · Configuration · Licensing · Troubleshooting
- Developers: Song API · Architecture · Extending Plenio · Testing · Design documents · Decisions
- Changelog: every change of the current version and the one before · Security and privacy: what Plenio downloads, starts and writes
Coming from the Music Production Toolkit?
Plenio is the successor of the Music Production Toolkit (formerly MiniMax Music Production Toolkit) - so much changed that it became a new project. Both can be installed side by side; old workflows keep working with the old toolkit, and there is no automatic migration of saved workflows. The prompt template library, the EQ and loudness presets and the compressor and limiter were carried over deliberately (verified sample by sample against the toolkit's output).
A few honest limits
- YuE2 sometimes renders a take to the length ceiling and stops mid-phrase; render another take. Instrumental is a strong request, not a guarantee: the optional Check Vocals measures the take and keeps the cleanest one.
- The ASR can mishear words. Covers and Enhance & Master show them on a Song Sheet so you can correct them before the release.
- Mastering is whole-song loudness with a gentle tone match after Audio HQ. There are no fades and no multiband processing.
- The player's videos need a browser that can encode video (current Chrome or Edge), and Plenio Drop needs WebGL2; the other visuals draw everywhere.
- Stems, Audio HQ 3 and Refine are experimental: their guarantees (a neutral mix returns the input, same rate and length, no normalisation) are tested, but how the models sound is decided by listening checks (test report). A LoRA's quality is its maker's - Plenio applies it, it cannot vouch for it.
Licences
- Plenio's code: Apache-2.0 (LICENSE, NOTICE.md); bundled frontend libraries: THIRD_PARTY.md.
- Model weights have their own licences and are not included. YuE2, YuE2-VAE, SheetSage2 and the instrumental adapter are CC BY-NC 4.0 (non-commercial). MiniMax Music 3 uses the MiniMax-Music3 Community License with commercial conditions. FLUX.2 Klein 4B, the Gemma 4 writer and faster-whisper are Apache-2.0 or MIT. A LoRA has its own licence. The release record names the licences of the models a song was made with; see Licensing.
Created by Johannes Plenio. This is an independent community project.