Are you confused with other complicated Stable Diffusion WebUIs? No problem, try ComfyUI.
It is a Node-based Stable Diffusion Web user Interface that assists AI artists in generating incredible art. There are multiple nodes that you can create for your workflow with just a drag-and-drop technique.
The best part of ComfyUI is you don't get the complicated multiple settings like we have in Automatic1111 which sometimes makes you confused.Table of Contents:
ComfyUI Dashboard
1. Workflow - At the top left corner, you will get the workflow button that guide you to manage the current workflow. Clicking on it will populate a drop-down menu with multiple options:
(a) New option- Helps to create new workflow from scratch.
(b) Open - lets to open the saved workflow which you want to work on. Select "Ctrl+O" to do this using shortcut key.
(c) Browse Templates- These are the default templates workflow which are mostly used by the community. These are Image generation, Img-to-Img,Two pass Upscaling and FLux schenll.
(d) Save- It normally saves your changes to the current workflow with default workflow name.
(e) Save As- This option saves the current workflow but with different name with extra file saving features.
(f) Export- This exports the workflows to your local directory.
(g) Export(API)- Helps for the developers who want to work with stand alone projects by exposing ComfyUI APIs as a backend. What we experienced is, this is one of the fastest way to build your start-up projects.
2. Edit- Its found besides the workflow button that comprises with following options:
(a) Undo- This keeps you back to your recent changes.
(b) Redo- Forword the changes which you did with Undo option.
(c) Clear Workflows- Clears the current workflow.
(d) Clipspace- helps you to work with the output image. Simply right click on output image and select this option to get working.
3. Manager- Naviagting to the top right corner, you will get this option which will help you to manage all your custom nodes, ComfyUI updates etc. Install it from our ComfyUI installation guide if you haven't done yet.
(a) Load-Unload model- This keeps you to unload the model for your currently loaded workflow. This is very helpful when you want to save the workflow if you stuck into out-of-memory errors with low VRAMS and other ComfyUI crashes. Then selecting "Queue" option will again reload the same models.
(b) Share- Instantly share your workflows online with the community on social platforms, websites etc.
4. Queue option- By default its present at the bottom. You can drag and set it where-ever you want. This executes the currently workflow that have been loaded into ComfyUI. It also downloads the required model if workflow has such configurations (at the first run) like we have experienced many times in various different image/video generation workflows.
ComfyUI Basic Nodes:
- Seed: It's normally the initial point where the random value is generated for any particular generated image. After the first generation, if you set its randomness to fixed, the model will generate the same style of image. This is one of the techniques to achieve consistency. Its default value is 0. The minimum value is 0 and the maximum value is in hexadecimal(0xffffffffffffffff) in actual its 1844674407370955. You must set your seed value between this specified range only.
- Steps: It refers to the inference steps means the number of steps the diffusion mechanism needs to generate an intermediate latent image sample processed in latent space. In each step, the image is processed from noising and denoising attempts to get the perfect output. The default is 20, the minimum value is 0 and the maximum is 10000.
- CFG: CFG(Classifier Free Guidance scale) It takes the float(decimal) values. Its default value is 8.0, minimum is 0.0 and 100.0 is the maximum value. It basically helps the diffusion models to follow and adds influence with the prompts. But, if you go further higher values you will get a totally different image perspective. So, usually closer to 7-8 is best to get the demanding results.
- Sampler Name: It's the type of algorithm for noising and denoising the latent image to achieve optimal performance. Many of the popular algorithms are DPM++, Euler, Euler A, etc.
Sampler Type | Relative Speed |
---|---|
Euler | Fast |
Euler a | Fast |
Heun | Medium |
LMS | Fast |
LMS Karras | Fast |
DDIM | Fast |
PLMS | Fast |
DPM2 | Medium |
DPM2 a | Medium |
DPM2 Karras | Medium |
DPM2 a Karras | Medium |
DPM++ 2S a | Medium |
DPM++ 2S a Karras | Medium |
DPM++ 2M | Fast |
DPM++ 2M Karras | Fast |
DPM++ SDE | Medium |
DPM++ SDE Karras | Medium |
DPM fast | Fast |
DPM adaptive | Slow |
UniPC | Fast |
- Scheduler: It's the Ksampler's Scheduler for scheduling techniques.
- Positive conditioning: The positive prompt we used to generate AI Art.
- Negative conditioning: It's the negative prompt that we want don't want in Image generation.
- Noise Scheduler: It generally controls how much noise you have in the image it should be in each step.
- Denoise factor: This is basically used when you are working in an "image-to-image" workflow. So, during conversion from latent to pixel and vice-versa it detects how much percentage we want to keep and change. If the denoising factor is 1 means 100% we don't want to keep any image but when we give 0.5 means 50% we want to change our image with 50% of as it is.
Its to take in mind that every diffusion model behaves different with its sampler method, its steps, CFG scale, positive, negative conditionings etc.
ComfyUI Shortcuts:
Sl. No | Shortcut Key | Description |
---|---|---|
1 | Ctrl + Enter | Queue up current graph for generation |
2 | Ctrl + Shift + Enter | Queue up current graph as first for generation |
3 | Ctrl + Z/Ctrl + Y | Undo/Redo |
4 | Ctrl + S | Save workflow |
5 | Ctrl + O | Load workflow |
6 | Ctrl + A | Select all nodes |
7 | Alt + C | Collapse/uncollapse selected nodes |
8 | Ctrl + M | Mute/unmute selected nodes |
9 | Ctrl + B | Bypass selected nodes (acts like the node was removed from the graph and the wires reconnected through) |
10 | Delete/Backspace | Delete selected nodes |
11 | Ctrl + Backspace | Delete the current graph |
12 | Space | Move the canvas around when held and moving the cursor |
13 | Ctrl/Shift + Click | Add clicked node to selection |
14 | Ctrl + C/Ctrl + Shift + V | Copy and paste selected nodes (maintaining connections from outputs of unselected nodes to inputs of pasted nodes) |
15 | Shift + Drag | Move multiple selected nodes at the same time |
16 | Alt + +(Plus) | Canvas Zoom in |
17 | Alt + -(minus) | Canvas Zoom out |
18 | Ctrl + Shift + LMB + Vertical drag | Canvas Zoom in/out |
19 | Q | Toggle visibility of the queue |
20 | H | Toggle visibility of history |
21 | R | Refresh graph |
22 | Double-Click LMB | Open node quick search palette |
23 | Ctrl+D | Load default graph workflow |
Use Command in place of Ctrl key, if you are a Mac user.