ToriiGate Llama.cpp Text Generate

A ComfyUI node in ToriiGate/API with 8 inputs and 1 output.

By litch230·Created 3 months ago·Updated 3 months ago· 20

◄promptDescribe the following topic in detail:►

◄server_urlhttp://127.0.0.1:8080►

◄model_nameDraconicDragon/ToriiGate-0.5-GGUF:Q4_K_M►

◄temperature0.70►

◄max_tokens512►

◄timeout120►

◄custom_model_name►

◄system_prompt►

CategoryToriiGate/API

Inputs (8)

Name	Type	Default	Description
prompt	STRING	Describe the following topic in detail:	User prompt sent to the llama-server.
server_url	STRING	http://127.0.0.1:8080	Base URL of the llama-server instance. Example: http://127.0.0.1:8080
model_name	COMBO	DraconicDragon/ToriiGate-0.5-GGUF:Q4_K_M	GGUF quantization to use. The identifier must match what the llama-server router registered (shown at startup as 'operator(): ...'). Q4_K_M is the recommended balance of quality vs size (3.07 GB). Use custom_model_name below to override with any arbitrary string.
temperature	FLOAT	0.700–2	Sampling temperature. 0 is deterministic (greedy); higher values introduce more randomness.
max_tokens	INT	51216–8192	Maximum number of tokens to generate.
timeout	FLOAT	1205–600	HTTP request timeout in seconds. Increase for slow hardware or very long generations.
custom_model_nameopt	STRING		Override the model identifier with any custom string. Useful when running a non-GGUF backend or a locally renamed model. Leave blank to use the dropdown above.
system_promptopt	STRING		Optional system prompt. Leave blank to omit the system turn.

Name	Type	Description
text	STRING	—