Skip to content

hoveychen/ComfyUI-CLIPSegPro

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Custom Nodes for ComfyUI: CLIPSegPro

This repository contains an enhanced custom node from ComfyUI CLIPSeg repository to generate masks for image inpainting tasks based on text prompts.

It's named after the original node with "Pro" suffix featuring:

  • Support GPU acceleration.
  • Support batch images.
  • Support specifying multiple text prompts separated by delimiter ";" in a single node to include multiple parts.

CLIPSegPro

The CLIPSegPro node generates a binary mask for a given input image and text prompt.

Inputs:

  • image: A torch.Tensor representing the input image.
  • text: A string representing the text prompt.
  • blur: A float value to control the amount of Gaussian blur applied to the mask.
  • threshold: A float value to control the threshold for creating the binary mask.
  • dilation_factor: A float value to control the dilation of the binary mask.

Outputs:

  • tensor_bw: A torch.Tensor representing the binary mask.
  • image_out_hm: A torch.Tensor representing the heatmap overlay on the input image.
  • image_out_bw: A torch.Tensor representing the binary mask overlay on the input image.

Installation

ComfyUI Manager

Follwing this guide to install this extension

Usage

Below is an example for the intended workflow. The json file for the example can be found inside the 'workflow' directory

Requirements

  • PyTorch
  • CLIPSeg
  • OpenCV
  • numpy
  • matplotlib

Make sure that you have the required libraries installed to the venv of ComfyUI.

About

ComfyUI CLIPSeg Pro

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%