ComfyUI Extension: ComfyUI-fal-API

Authored by gokayfem

Created

Updated

103 stars

Custom nodes for using fal API. Video generation with Kling, Runway, Luma. Image generation with Flux. LLMs and VLMs OpenAI, Claude, Llama and Gemini.

Custom Nodes (0)

    README

    ComfyUI-fal-API

    Custom nodes for using Flux models with fal API in ComfyUI with only one API Key for all.

    Table of Contents

    Installation

    1. Navigate to your ComfyUI custom nodes directory:

      cd custom_nodes

    2. Clone this repository:

      git clone https://github.com/gokayfem/ComfyUI-fal-API.git

    3. Install the required dependencies:

      pip install -r requirements.txt

    Configuration

    1. Get your fal API key from fal.ai

    2. Open the config.ini file inside custom_nodes/ComfyUI-fal-API

    3. Replace <your_fal_api_key_here> with your actual fal API key:

      [API]
FAL_KEY = your_actual_api_key

    Usage

    After installation and configuration, restart ComfyUI. The new nodes will be available in the node browser under the "FAL" category.

    Available Nodes

    Image Generation

    • Flux Pro (fal): Generate high-quality images using the Flux Pro model
    • Flux Dev (fal): Use the development version of Flux for image generation
    • Flux Schnell (fal): Fast image generation with Flux Schnell
    • Flux Pro 1.1 (fal): Latest version of Flux Pro for image generation
    • Flux General (fal): ControlNets, Ipadapters, Loras for Flux Dev

    Video Generation

    • Kling Video Generation (fal): Generate videos using the Kling model
    • Kling Pro v1.0 Video Generation (fal): Original version of Kling Pro for video generation
    • Kling Pro v1.6 Video Generation (fal): Latest version of Kling Pro with improved quality
    • Kling Master v2.0 Video Generation (fal): Advanced video generation with Kling Master
    • Runway Gen3 Image-to-Video (fal): Convert images to videos using Runway Gen3
    • Luma Dream Machine (fal): Create videos with Luma Dream Machine
    • MiniMax Video Generation (fal): Generate videos using MiniMax model
    • MiniMax Text-to-Video (fal): Create videos from text prompts using MiniMax
    • MiniMax Subject Reference (fal): Generate videos with subject reference using MiniMax
    • Google Veo2 Image-to-Video (fal): Convert images to videos using Google's Veo2 model
    • Wan Pro Image-to-Video (fal): High-quality video generation with Wan Pro model
    • Video Upscaler (fal): Upscale video quality using AI
    • Combined Video Generation (fal): Generate videos using multiple services simultaneously
      • Supports Kling Pro v1.6, Kling Master v2.0, MiniMax, Luma, Veo2, and Wan Pro
      • Each service can be individually enabled/disabled
      • Wan Pro runs with safety checker enabled and automatic seed selection
    • Load Video from URL: Load and process videos from a given URL

    Language Models (LLMs)

    • LLM (fal): Large Language Model for text generation and processing
      • Available models:
        • google/gemini-flash-1.5-8b
        • anthropic/claude-3.5-sonnet
        • anthropic/claude-3-haiku
        • google/gemini-pro-1.5
        • google/gemini-flash-1.5
        • meta-llama/llama-3.2-1b-instruct
        • meta-llama/llama-3.2-3b-instruct
        • meta-llama/llama-3.1-8b-instruct
        • meta-llama/llama-3.1-70b-instruct
        • openai/gpt-4o-mini
        • openai/gpt-4o

    Vision Language Models (VLMs)

    • VLM (fal): Vision Language Model for image understanding and text generation
      • Available models:
        • google/gemini-flash-1.5-8b
        • anthropic/claude-3.5-sonnet
        • anthropic/claude-3-haiku
        • google/gemini-pro-1.5
        • google/gemini-flash-1.5
        • openai/gpt-4o
      • Supports various tasks such as image captioning, visual question answering, and more

    Troubleshooting

    If you encounter any errors during installation or usage, try the following:

    1. Ensure you have the latest version of ComfyUI installed
    2. Update this custom node package: 
      cd custom_nodes/ComfyUI-FLUX-fal-API
git pull
pip install -r requirements.txt
    3. If you're using ComfyUI Windows Portable, you may need to install fal-client manually: 
      ComfyUI_windows_portable>.\python_embeded\python.exe -m pip install fal-client

    License

    This project is licensed under the Apache License 2.0. See the LICENSE file for details.

    Contributing

    Contributions are welcome! Please feel free to submit a Pull Request.

    Support

    If you encounter any issues or have questions, please open an issue on the GitHub repository.