ComfyUI Node
Griptape Agent Config: HuggingFace Drivers
HuggingFace Structure Config.
Griptape Agent Config: HuggingFace Drivers
- CONFIG
◄prompt_model_commentPrompt Driver►
◄modelHuggingFaceH4/zephyr-7b-beta►
◄max_attempts_on_fail2►
◄temperature0.10►
◄seed10342349342►
◄use_native_toolstrue►
◄max_tokens-1►
◄api_token_env_varHUGGINGFACE_HUB_ACCESS_TOKEN►
◄embedding_model_commentEmbedding Driver►
◄embedding_modelsentence-transformers/all-MiniLM-L6-v2►
◄tokenizersentence-transformers/all-MiniLM-L6-v2►
◄max_output_tokens512►
CategoryGriptape/Agent Configs
Inputs (12)
| Name | Type | Default | Description |
|---|---|---|---|
| prompt_model_commentopt | STRING | Prompt Driver | — |
| modelopt | STRING | HuggingFaceH4/zephyr-7b-beta | The model to use from Hugging Face Hub. |
| max_attempts_on_failopt | INT | 21–100 | Maximum attempts on failure |
| temperatureopt | FLOAT | 0.100–1 | Temperature for sampling |
| seedopt | INT | 10342349342 | Seed for random number generation |
| use_native_toolsopt | BOOLEAN | true | Use native tools for the LLM. |
| max_tokensopt | INT | -1 | Maximum tokens to generate. If <=0, it will use the default based on the tokenizer. |
| api_token_env_varopt | STRING | HUGGINGFACE_HUB_ACCESS_TOKEN | Environment variable for the API token. Do not use your actual API key here. |
| embedding_model_commentopt | STRING | Embedding Driver | — |
| embedding_modelopt | STRING | sentence-transformers/all-MiniLM-L6-v2 | The model to use for embeddings. |
| tokenizeropt | STRING | sentence-transformers/all-MiniLM-L6-v2 | The tokenizer to use with the model. |
| max_output_tokensopt | INT | 512 | The maximum number of tokens for the output. |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| CONFIG | CONFIG | — |