Nodes/Replicate API NM/🤖 Replicate 萬用生成 / Universal Generator (All Models)
ComfyUI Node

🤖 Replicate 萬用生成 / Universal Generator (All Models)

Run Sora, Veo and Nano Banana from one ComfyUI node — no GPU required

By neurmostudio0409·Created 8 months ago·Updated about a month ago· 0
🤖 Replicate 萬用生成 / Universal Generator (All Models)
  • images
  • last_frame
  • video
  • audio
  • video
  • audio
  • image
  • file_path
  • info
modelsora-2
prompt
aspect_ratiolandscape
resolution720p
quality1080p
sync_modeloop
temperature0.5
active_speakerfalse
guidance3.5
guidance_scale7.5
output_formatwebp
output_quality80
image_searchfalse
google_searchfalse
alpha_ceil250
alpha_floor6
num_inference_steps50
num_frames81
fps6
duration8
prompt_optimizertrue
prompt_upsamplingfalse
model_versionstereo-large
num_samples4
generate_audiotrue
face_enhancefalse
scale2
motion_bucket_id127
seed-1
camera_motionnone

The 🤖 Replicate 萬用生成 / Universal Generator is the node that finally lets you skip the search for a local Nano Banana checkpoint. Stop looking - there isn't one. Sora 2, Veo 3.1, Nano Banana Pro, Kling, Seedance: none of them have open weights, so "run it locally" is off the table at any VRAM budget. This node is the other door. You pick a model from a dropdown of 34, type a prompt, and the node packages everything up and sends it to Replicate's cloud, then drops the result back into your graph as native VIDEO, IMAGE, or AUDIO - as if a local sampler had made it.

This is the API-wrapper pattern in its cleanest form: a ComfyUI node that is really an HTTP client with your key baked in. The official ComfyUI Partner Nodes do the same job on prepaid credits through your Comfy account; this one instead uses your own Replicate token and Replicate's pay-per-call billing. Same closed models, different meter, and it also runs open models (FLUX schnell, Wan, Stable Video Diffusion) on someone else's GPU if yours can't cope.

How it works

The model dropdown is the only required input - everything else is optional and, crucially, inert when the selected model doesn't use it. ComfyUI can't hide parameters on a dropdown node, so all ~30 of them sit there, but the node filters the ones each model needs before the API call. You don't need to know whether Veo wants a "guidance_scale" or a "duration"; it just picks the relevant ones.

The one input you'll actually touch beyond prompt is images - a unified socket that auto-routes to whatever the model calls its image parameter: Veo/Wan get image, Sora gets input_reference, MiniMax gets a first frame, Kling gets a start image, and Nano Banana/Seedance get a full reference-image list. Wire the pack's Multi Image Input node in here and Nano Banana can see all 14 references in one call. last_frame stays separate, for Veo's end-frame editing. A video + audio pair handles the lipsync models.

Under the hood there's real engineering, not just a token request. Predictions are created with wait=False and then polled, so a five-minute Veo render won't trip a read timeout. Results download to ComfyUI's temp directory, and the outputs come out as native types: videoSave Video, imageSave Image, audioSave Audio. Backend ffmpeg muxes models that return separate video and audio streams back into one file, and a 1-second debounce means double-clicking Run doesn't bill you twice. file_path carries a .glb path for the 3D model, info carries execution details.

What to watch

Cost. This is metered per call, and the video jobs are where a session gets expensive fast - a handful of 4K Veo clips can outspend a month of Comfy Cloud. It's the real price of models that refuse to run locally, not a bug. Also: your prompts and reference images leave the machine, and the closed models enforce their own content filters - there are no weights to abliterate.

Install

ComfyUI Manager, search Replicate API NM, or:

cd ComfyUI/custom_nodes
git clone https://github.com/neurmostudio0409/ComfyUI-replicate-api-NM
cd ComfyUI-replicate-api-NM
pip install -r requirements.txt

Then create a .env in the pack folder with your token from https://replicate.com/account/api-tokens (the pack reads it on load), and make sure FFmpeg is on your PATH - it's the system dependency for audio muxing (choco install ffmpeg, brew install ffmpeg, or apt install ffmpeg). Python deps are just replicate, requests, opencv-python, soundfile, scipy - nothing exotic, and torch is ComfyUI's.

If you get a token error, check the .env format (export REPLICATE_API_TOKEN=r8_...); a "model parameter" error means a required input is missing and the node's preflight now catches it before it bills you. Old Veo timeouts and Grok image-format errors were fixed in v2.5.x - if you hit those, update. It's a small pack (this page has essentially zero search impressions yet), but it's GPL open source, on the Comfy Registry, and ships 21 unit tests with CI. Any node that holds your API key and phones home by design is worth eyeballing before first run - that's the category's one honest caution, not a strike against this one.

Categoryreplicate

Inputs (34)

NameTypeDefaultDescription
modelCOMBOsora-2選擇模型 / Select Model - 節點將自動使用該模型需要的參數 / Node will automatically use parameters required by this model
promptoptSTRING提示詞 / Prompt - 用於 Sora, Veo, MiniMax 等 / Used for Sora, Veo, MiniMax, etc.
imagesoptIMAGE,REPLICATE_IMAGE_LIST圖片輸入(統一)/ Images (unified) - 接單張圖、batch 或多圖輸入節點;後端自動分配到模型對應參數(Veo/Wan=輸入圖、Sora=參考圖、MiniMax=首幀、Kling=起始圖、Nano Banana/Seedance=多張參考圖)/ Automatically routed to the model's image parameter(s).
last_frameoptIMAGE末幀圖片 / Last Frame - Veo 使用,獨立輸入 / Used for Veo, dedicated input
videooptVIDEO輸入影片 / Input Video - Lipsync 使用 / Used for Lipsync
audiooptAUDIO輸入音訊 / Input Audio - Lipsync, MusicGen 使用 / Used for Lipsync, MusicGen
aspect_ratiooptCOMBOlandscape長寬比 / Aspect Ratio - Sora, FLUX, Nano Banana, Grok 使用 / Used for Sora, FLUX, Nano Banana, Grok
resolutionoptCOMBO720p解析度 / Resolution - Veo, Nano Banana 使用 / Used for Veo, Nano Banana
qualityoptCOMBO1080p影片品質 / Video Quality - PixVerse 使用 / Used for PixVerse
sync_modeoptCOMBOloop同步模式 / Sync Mode - Lipsync 使用 / Used for Lipsync
temperatureoptFLOAT0.50–2溫度 / Temperature - Lipsync, LLM 使用 / Used for Lipsync, LLM
active_speakeroptBOOLEANfalse啟用發言者偵測 / Active Speaker Detection - Lipsync 使用 / Used for Lipsync
guidanceoptFLOAT3.51.5–5引導強度 / Guidance - FLUX 使用 / Used for FLUX
guidance_scaleoptFLOAT7.51–20引導比例 / Guidance Scale - Wan, SVD 使用 / Used for Wan, SVD
output_formatoptCOMBOwebp輸出格式 / Output Format - 圖片生成使用 / Used for image generation
output_qualityoptINT800–100輸出品質 / Output Quality - 圖片生成使用 / Used for image generation
image_searchoptBOOLEANfalseGoogle 圖片搜尋參考 / Image Search grounding - Nano Banana 2 使用
google_searchoptBOOLEANfalseGoogle 網頁搜尋 / Web Search grounding - Nano Banana 2 使用
alpha_ceiloptINT2500–255透明度上限 / Alpha Ceil - Nano Banana Transparent 使用
alpha_flooroptINT60–255透明度下限 / Alpha Floor - Nano Banana Transparent 使用
num_inference_stepsoptINT501–100推理步數 / Inference Steps - 影片生成使用 / Used for video generation
num_framesoptINT811–200幀數 / Frame Count - Wan, SVD 使用 / Used for Wan, SVD
fpsoptINT61–30每秒幀數 / FPS - SVD 使用 / Used for SVD
durationoptINT81–30時長(秒) / Duration (seconds) - 影片生成使用 / Used for video generation
prompt_optimizeroptBOOLEANtrue提示詞優化 / Prompt Optimizer - MiniMax 使用 / Used for MiniMax
prompt_upsamplingoptBOOLEANfalse提示詞增強 / Prompt Upsampling - P-Video 使用
model_versionoptCOMBOstereo-large模型版本 / Model Version - MusicGen 使用
num_samplesoptINT41–10樣本數 / Samples - Video to SFX 使用
generate_audiooptBOOLEANtrue生成音訊 / Generate Audio - Seedance 2.0 使用 / Used for Seedance 2.0
face_enhanceoptBOOLEANfalse臉部增強 / Face Enhancement - Real-ESRGAN 使用 / Used for Real-ESRGAN
scaleoptINT21–4放大倍數 / Upscale Factor - Real-ESRGAN 使用 / Used for Real-ESRGAN
motion_bucket_idoptINT1271–255運動強度 / Motion Bucket - SVD 使用 / Used for SVD
seedoptINT-1-1–18446744073709550000種子值 / Seed - Seedance 等使用 / Used for Seedance etc. (-1 = random)
camera_motionoptCOMBOnone鏡頭運動 / Camera Motion - LTX-2.3 使用 / Used for LTX-2.3

Outputs (5)

NameTypeDescription
videoVIDEO
audioAUDIO
imageIMAGE
file_pathSTRING
infoSTRING