Extensions/ComfyUI-Transformers
ComfyUI Extension

ComfyUI-Transformers

ComfyUI-Transformers is a cutting-edge project combining the power of computer vision and natural language processing to create intuitive and user-friendly interfaces. Our goal is to make technology more accessible and engaging.

By kadirnar·Created 3 years ago·Updated 7 months ago· 25
kadirnar/ComfyUI-Transformers
Nodes33
On cloudLocal install
CategoryTransformers/Audio/AudioClassification, Transformers/Audio/SpeechRecognition
Stars25
Updated7 months ago

Nodes (33)

Audio Classification

What's That Sound? Audio Classification in ComfyUI

Transformers/Audio/AudioClassification
Speech Recognition (ASR)

Whisper ASR

Transformers/Audio/SpeechRecognition
Conversational

Chat With a Model Inside ComfyUI (Conversational)

Transformers/NLP/Conversational
Depth Estimation

Depth Estimation

Transformers/DepthEstimation
Document Question Answering

Document QA

Transformers/Multimodal/DocumentQA
Feature Extraction

Feature Extraction

Transformers/Multimodal/FeatureExtraction
Fill Mask

Fill Mask in ComfyUI

Transformers/NLP/FillMask
Float to String

Convert Numbers to Text in ComfyUI (Float to String)

Transformers/Utility
Image Classification

What Is This Image? Image Classification in ComfyUI

Transformers/ImageClassification
Image Feature Extraction

Image Feature Extraction

Transformers/ImageFeatureExtraction
Image Segmentation

Segmentation in ComfyUI

Transformers/ImageSegmentation
Image-Text to Text

Image-Text to Text in ComfyUI

Transformers/Multimodal/ImageTextToText
Image to Image

Upscale or Transform Images With One Node (Image to Image)

Transformers/ImageToImage
Image to Text

Auto-Caption Any Image Inside ComfyUI (Image to Text)

Transformers/Multimodal/ImageToText
Int to String

Turn a Number Into Text in ComfyUI (Int to String)

Transformers/Utility
Load Depth Model

The Load Node for ComfyUI's Depth Workflow

Transformers/DepthEstimation
Mask Generation

Automatic Mask Generation

Transformers/MaskGeneration
Object Detection

Drop a DETR model into your graph

Transformers/ObjectDetection
Question Answering

Extract Answers From Text in ComfyUI (Question Answering)

Transformers/NLP/QuestionAnswering
Sentence Similarity

Score how close two texts are — the node that can gate your workflow

Transformers/NLP/SentenceSimilarity
String to Float

The boring utility that keeps your graph from screaming at you

Transformers/Utility
String to Int

StringToInt — convert a text value into an integer ComfyUI can use

Transformers/Utility
Table Question Answering

Ask your data a question in the middle of a diffusion workflow

Transformers/NLP/TableQuestionAnswering
Text Classification

Give your graph a sentiment check before it spends a generation

Transformers/NLP/TextClassification
Text Generation

The prompt-generator node — and the trap that makes it lie to you

Transformers/NLP/TextGeneration
Text to Speech

Text to Speech with Bark

Transformers/Audio/TextToSpeech
Token Classification (NER)

Pull the people, places, and organizations out of any text

Transformers/NLP/TokenClassification
Video Classification

What's happening in that clip? The node that labels video content

Transformers/VideoClassification
Visual Question Answering

Ask your generated image a question and let it answer

Transformers/Multimodal/VisualQA
Zero-Shot Audio Classification

Classify any audio into labels you invent on the spot

Transformers/Audio/ZeroShotAudioClassification
Zero-Shot Classification

Sort text into categories you invent — no training required

Transformers/NLP/ZeroShotClassification
Zero-Shot Image Classification

Does this image contain a cat? Ask CLIP, no training involved

Transformers/ZeroShotImageClassification
Zero-Shot Object Detection

Zero-Shot Detection With OWL-ViT

Transformers/ZeroShotObjectDetection
Readme
<div align="center"> <h2> ComfyUI-Transformers: </h2> <div> <img width="800" alt="teaser" src="doc\yolo_logo.webp"> </div> </div>

🛠️ Installation

cd custom/nodes
git clone https://github.com/kadirnar/ComfyUI-Transformers

Depth Estimation

<img width="1000" alt="Depth Estimation" src="docs/depth_midas.png">