Nodes/comfyui_LLM_schools/Causal Language Model Trainer
ComfyUI Node

Causal Language Model Trainer

A ComfyUI node in 大模型学校(llm_schools)/模型训练(Model Training) with 7 inputs and 1 output.

By heshengtao·Created 2 years ago·Updated 2 years ago· 7
Causal Language Model Trainer
  • args
  • peft_args
  • log
split_datapaths
model_name_or_pathgpt2
deviceauto
dtypefloat32
fine_tuning_methodfull_fine_tuning
Category大模型学校(llm_schools)/模型训练(Model Training)

Inputs (7)

NameTypeDefaultDescription
split_datapathsSTRING
model_name_or_pathSTRINGgpt2
deviceCOMBOauto4 options: auto, cuda, cpu, mps
dtypeCOMBOfloat325 options: float32, float16, bfloat16, int8, int4
argsARGS[object Object]
fine_tuning_methodCOMBOfull_fine_tuning7 options: full_fine_tuning, lora, adapter, p-tuning, prompt_tuning, prefix-tuning, +1
peft_argsoptARGS[object Object]

Outputs (1)

NameTypeDescription
logSTRING