ComfyUI Node
Griptape Prompt Driver: Amazon SageMaker Jumpstart
Griptape Driver
Griptape Prompt Driver: Amazon SageMaker Jumpstart
- DRIVER
◄modelmeta-llama/Meta-Llama-3-8B-Instruct►
◄max_attempts_on_fail2►
◄temperature0.10►
◄seed10342349342►
◄use_native_toolstrue►
◄max_tokens-1►
◄endpointjumpstart-dft-...►
◄aws_access_key_id_env_varAWS_ACCESS_KEY_ID►
◄aws_secret_access_key_env_varAWS_SECRET_ACCESS_KEY►
◄aws_default_region_env_varAWS_DEFAULT_REGION►
CategoryGriptape/Agent Drivers/Prompt
Inputs (10)
| Name | Type | Default | Description |
|---|---|---|---|
| modelopt | STRING | meta-llama/Meta-Llama-3-8B-Instruct | Specify the model to use. Default is Meta-Llama-3-8B-Instruct. |
| max_attempts_on_failopt | INT | 21–100 | Maximum attempts on failure |
| temperatureopt | FLOAT | 0.100–1 | Temperature for sampling |
| seedopt | INT | 10342349342 | Seed for random number generation |
| use_native_toolsopt | BOOLEAN | true | Use native tools for the LLM. |
| max_tokensopt | INT | -1 | Maximum tokens to generate. If <=0, it will use the default based on the tokenizer. |
| endpointopt | STRING | jumpstart-dft-... | Specify the SageMaker endpoint to use. |
| aws_access_key_id_env_varopt | STRING | AWS_ACCESS_KEY_ID | Enter the name of the environment variable for your AWS_ACCESS_KEY_ID, not your actual key. |
| aws_secret_access_key_env_varopt | STRING | AWS_SECRET_ACCESS_KEY | Enter the name of the environment variable for your AWS_SECRET_ACCESS_KEY, not your actual key. |
| aws_default_region_env_varopt | STRING | AWS_DEFAULT_REGION | Enter the name of the environment variable for your AWS_DEFAULT_REGION, not your actual region. |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| DRIVER | PROMPT_DRIVER | — |