ComfyUI Node: SambaNova LLM

Authored by Apache0ne

Created

Updated

2 stars

Category

LLM

Inputs

prompt STRING
model
  • Meta-Llama-3.1-8B-Instruct
  • Meta-Llama-3.1-70B-Instruct
  • Meta-Llama-3.1-405B-Instruct
  • Meta-Llama-3.2-1B-Instruct
  • Meta-Llama-3.2-3B-Instruct
max_tokens INT
temperature FLOAT
top_p FLOAT
top_k INT
request_type
  • completion
  • chat
system_message STRING
stop_sequences STRING
conversation_id STRING
repetition_penalty FLOAT
stream BOOLEAN

Outputs

STRING

INT

STRING

Extension: SambaNova

Super Fast LLM's llama3.1-405B,70B,8B and more

Authored by Apache0ne

View Nodes

Run ComfyUI workflows in the Cloud!

No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues

Learn more