apachellmpack
A node pack for cerebras, groq, and SambNova hosted models.
LLM Pack
A pack for using the LLm models hosted by Cerebras, Groq, and SambNova
this image is outdated by about 3 months, top 3 are faster now
dependencies
'groq'
Installation
API KEYS HERE(Cerebras may be still in devs only, email or reach out to their many media pages.(might hook you up with a key)):
https://cloud.sambanova.ai/apis
https://cloud.cerebras.ai/platform/org_khtphhjfktpfxvvfnwmxy8tp/apikeys
https://console.groq.com/keys
Place KEYS inside the Config files
nodes\cerebras...
nodes\groq...
nodes\Nova...
ComfyUI-Manager (Rec)
Can Download from Comfy Manager
IF using Windows Port version
ComfyUI Folder
cmd
pip install groq
Inside Custom_nodes Folder
git clone https://github.com/Apache0ne/apachellmpack.git
IF using Matrix
Inside venv\Scripts
activate
pip install groq
Inside Custom_nodes Folder
git clone https://github.com/Apache0ne/apachellmpack.git
known issues
Cerebras presets dont work
streaming mode doesnt work in comfy(might one day)
might add
Cerebras thinking and planning support
credit to
MNeMoNiCuZ
for the base groq node