Comfyui best upscale model for upscaling We will use these to scale up images we love while adding details and even injecting additional prompts along the way! Welcome to the unofficial ComfyUI subreddit. From restoring to upscaling, what's s_noise and which sampler works with the restoration_scale, it's all in there. 2024. 7k. /comfy. Upscayl will use the model file name to detect the scale that it supports. For illustration/anime models you will want something smoother that would tend to look “airbrushed” or overly smoothed out for more realistic images, there are many options. RealESRGAN_x2plus. 5 if you want to divide by 2) after upscaling by a model. 5, but I have some really old images I'd like to add detail to. Since you have only 6GB VRAM i would choose tile controlnet + sd ultimate upscale. Understand how low-resolution images can be transformed into high-definition ones using different methods and algorithms. What's the best upscale model? upvotes PSA: RealPLKSR is a new, FANTASTIC (and fast!) 4x upscaling architecture upvotes Created by: CgTopTips: In this video, we'll dive into the amazing world of Tile ControlNet for models. 25x uspcale, it will run it twice for 1. Is there a significant faster upscaler with good quality which I could use? Thanks! Fredsk Saved searches Use saved searches to filter your results more quickly You just have to use the node "upscale by" using bicubic method and a fractional value (0. 0 reviews. OpenModelDb. Introduction. Look at this workflow : 🎨 Dive into the world of image upscaling with our latest video, as we explore and compare various methods using ComfyUI! 🚀ComfyUI: https://github. If you use Iterative Upscale, it might be better to approach it by adding noise using techniques like noise injection or unsampler hook. Core Nodes. If the upscaled size is larger than the target size (calculated from the upscale factor upscale_by), then Welcome to the unofficial ComfyUI subreddit. Hi, I am upscaling a long sequence (batch - batch count) of images, 1 by 1, from 640x360 to 4k. Other options would be Ultimate SD Upscale, which imo is the best upscaling option Created by: CgTopTips: Advanced Image Upscaling in ComfyUI Using Flux Flux Image Upscaling in ComfyUI is an invaluable tool for anyone looking to upscale images while preserving quality and delivering results quickly, making it perfect for use in both creative and production environments. When you go high the the controls are relaxed and the denoising is increased intentionally to allow As such, it's NOT a proper native ComfyUI implementation, so not very efficient and there might be memory issues, tested on 4090 and 4x upscale tiled worked well for the upscale nodes. fix but since I'm using XL I skip that and go straight to Img2img, and do a SD Upscale by 2x. After 2 days of testing, I found Ultimate SD Upscale to be detrimental here. The video demonstrates how to integrate a large language model (LLM) for creative image results without adapters or control nets. Share Sort by: Best. What's the recommended way to fix the faces after upscaling We’re on a journey to advance and democratize artificial intelligence through open source and open science. image. I'm using your basic upscale latent -> ksampler approach to upscaling my generations, but as you can see in the picture, the original image has a load of character and fine detail, but the higher resolution 49 votes, 12 comments. Try immediately VAEDecode after latent upscale to see what I mean. 0 = 0. Have any of you guys worked with really small images to try to get a decent upscale? (in the 250 pixel range)? I assume most everything is 512 and higher based on SD1. I've never had good luck with latent upscaling in the past, which is "Upscale Latent By" and then re-sampling. Didnt play with settings yet, but its kind of magic. latent upscale vs upscale model (ultrasharp×4) Share Add a Comment. I tried all the possible upscalers in ComfyUI (LDSR, Latent Upcale, several models such as NMKV, the Ultimate SDUpscale node, "hires fix" (yuck!), the Iterative Latent upscale via pixel space node (mouthful), and even bought a The first is to use a model upscaler, which will work out of your image node, and you can download those from a website that has dozens of models listed, but Learn how to upscale images using ComfyUI and the 4x-UltraSharp model for At present, there are two mainstream methods of upscale: Upscale pixel: The visible image is directly upscaled. I'm new to the channel and to ComfyUI, and I come looking for a solution to an upscaling problem. outputs. This is not the case. It's why you need at least 0. The video also demonstrates enhancing the workflow with features like Latent Upscale and Model [rgthree] Note: If execution seems broken due to forward ComfyUI changes, you can disable the optimization from rgthree settings in ComfyUI. If you are looking for upscale models to use you can find some Learn how to upscale images using ComfyUI and the Flux model with GGUF support and ControlNet integration. In a base+refiner workflow though upscaling might not look straightforwad. 4x_NMKD-Siax_200k. You switched accounts on another tab or window. 5 Install this extension via the ComfyUI Manager by searching for ComfyUI Impact Pack. I'm looking for a workflow for ComfyUI that can take an uploaded image and generate an identical one, but upscaled using Ultimate SD Upscaling. example. You signed out in another tab or window. Check the size of the upscaled image. 04. The UPSCALE_MODEL output is the actual upscaling model object that has been loaded based on the specified model_name. The downside is that it takes a very long time. 5. 9, end_percent 0. I find Upscale useful, but as I often Upscale to 6144 x 6144 GigaPixel has the batch speed and capacity to make 100+ Upscales worthwhile. In this article, we’ll walk through the setup, features, and a detailed step-by-step guide on how to It's a 128px model so the output faces after faceswapping is blurry and low res. Taking the output of a KSampler and running it through a latent upscaling node results in major artifacts (lots of horizontal and vertical lines, and blurring). * If you are going for fine details don't upscale in 1024x1024 Tiles on an SD15 model, unless the model is specifically trained on such large sizes. Topics ai upscale image2image upscaler img2img image-upscaling image-upscaler image-upscale upscalerimage stable-diffusion comfyui comfyui-workflow In this easy ComfyUI Tutorial, you'll learn step-by-step how to upscale in ComfyUI. You get to know different ComfyUI Upscaler, get exclusive access to my Co By selecting the appropriate model name, you can ensure that the node loads the correct model that best suits your upscaling needs. takes a long long time. That's because of the model upscale. This powerful technique allows you to dramatically improve image quality, taking even the most poor-quality photos and turning Updates. What is the best way to upscale? Gourieff / comfyui-reactor-node Public. of concept: Node to steer tiled upscaling using IPAdapter Thought ipadapter could be a good way to control tiled upscaling. Open the command prompt and type these commands: Open the command prompt and type these commands: python_embeded\python. py --auto-launch --listen --fp32-vae Latent upscale is different from pixel upscale. 09/06/24 - Added an alternative version of the Flux Latent Upscaler workflow, this modified version uses Hyper Flux loras and a new clip text encoder made specifically for Flux and SD3, combined these cut inference time from hey folks, latly if have been getting in to the whole comfyui thing and trying different things out. It covers adding checkpoint nodes, prompt sections, and generating images with a k-sampler. the image upscale is pretty much the only distortion-“free” way to do it. I saw article about upscaling in ComfyUi and though, i have not really seen much info about latent upscaling. exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-SUPIR\requirements. I hope it Place the Model in the models\unet folder, VAE in models\VAE and Clip in models\clip folder of ComfyUI directories. MODEL_NAME. Click the Manager button in the main menu; 2. One of the most commonly used ways to increase both the dimensions and fidelity of an output image is to use what’s known as Hires fix during the txt2img generation process. So from VAE Decode you need a "Uplscale Image (using model)" under loaders. I often reduce the size of the video and the frames per second to speed up the process. Most of the workflows focus on upscaling with Ultimate SD Upscale or just plainly upscaling with model. Hey guys and gals, I got A LOT of dms about SUPIR so I made a full video on all of its settings. English; You can load this image in ComfyUI open in new window to get the workflow. Please share your tips, tricks, and workflows for using this software to create your AI art. can watch the video to see a real-time demonstration and gain a 21K subscribers in the comfyui community. now i have made a workflow that has a upscaler in it and it works fine only thing is that it upscales everything and that is not worth the wait with most outputs. Download some upscale models to get started, for example. I have been experimenting with AI videos lately. If you want more details latent upscale is better, and of course noise injection will let more details in (you need noises in order to diffuse into details). The latent upscale in ComfyUI is crude as hell, basically just a "stretch this image" type of upscale. NO PROMPT NEEDED - It just works!! How to use this workflow Simply drag and drop the image you want to upscale into the BASIC SETTINGS group box, select your favourite SD 1. If you are not interested in having an upscaled image completely faithful to the original you can create a draft with the base model in just a bunch of steps, then upscale the latent and apply a second pass with the base and a third pass with the Thanks. This doesn't affect the post-processing scaling option, this only affects the actual upscaling via ESRGAN. so thanks for that A lot of image to image upscaling (image to image) is for sharpening already decent photos. sh: line 5: 8152 Killed python main. I think the "8NMKDFaces160000G_v10" model gives the best skin texture output while at the same time doing an ok job of preserving other textures in the picture. Then another node under loaders> "load upscale model" node. I call changed the upscale modelwhich helped. For some context, I am trying to upscale images of an anime village, something like Ghibli style. Step-by-step guide for sharp and clear results. For this form of upscaling, a Machine Learning Model is trained on image pairs (called a dataset) of a low-resolution and a high-resolution version of the same image. ComfyUI Manual. If the model file name has 'x2' or '2x' in its name, Upscayl-NCNN will set the target resolution for upscaling accordingly. On first use. Explore the concept of Upscale in AI-based image generation with ComfyUI. Open "Upscaling with model" is an operation with normal images and we can operate with corresponding model, such as 4x_NMKD-Siax_200k. Model Type: Super resolution; Model Stats: Number of The realistic model that worked the best for me is JuggernautXL even the base 1024x1024 images were coming nicely. Images are too blurry and lack of details, it's like upscaling any regular image with some traditional methods. It covers the use of custom nodes like Created by: Mad4BBQ: What this workflow does Extremely EASY to use upscaler/detailer that uses lighting fast LCM and produces highly detailed results that remain faithful to the original image. 0. so my question is, is there a way to upscale a already existing image in comfy or do i need to do that in a1111? Created by: sk8583: In this workflow you can train your model for face model, swap it and upscale it for video and images. From the ComfyUI_examples, there are two different 2-pass (Hires fix) methods, one is latent scaling, one is non-latent scaling Now there's also a `PatchModelAddDownscale` node. We will also use the manager node. 4x-UltraSharp. I use SD mostly for upscaling real portrait photography so facial fidelity (accuracy to source) is my priority. IMAGE. 😀 The tutorial introduces ComfyUI's Flux with LLM for image upscaling, focusing on a workflow that simplifies the process. Hi, guys. Make sure you restart ComfyUI and Refresh your browser. The upscaled images. Connect the Load Upscale model with the Upscale Image (using model) to VAE Decode, then from that image to your preview/save image. Usually I use two my wokrflows: Superscale is the other general upscaler I use a lot. com/comfy Put them in the models/upscale_models folder then use the UpscaleModelLoader node to load them and the ImageUpscaleW Skip to main content. Notifications You must be signed in to change notification settings; Fork 170; Star 1. 5=1024). Remember that 2x, 4x, 8x means it will upscale the original resolution x2, x4, x8 times. 📂 The default installation path for upscaler models in ComfyUI can vary depending on the installation method. The Ultimate SD Upscale model is the most difficult choice in this whole process. pth "Latent upscale" is an operation in latent space and I don't know any way to use the model, mentioned above, in latent space. Select the upscale models. The low model on the left has 474 x 711. 🔄 The Iterative Upscale node is another option, connected to 'Pixel KSampler Upscale' and the model's VAE for upscaling. I did some simple comparison 8x upscaling 256x384 to 2048x3072. 5 or 2x upscale. The only approach I've seen so far is using a the Hires fix node, where its latent input comes from AI upscale > downscale image, nodes. You can do it in one go if you have the vram. g. 5 I'd go for Photon , RealisticVision or epiCRealism . Created by: sk8583: In this workflow you can train your model for face model, swap it and upscale it for video and images. Instead, I use Tiled KSampler with 0. 25, 1. The best method as said below is to upscale the image with a model ( then downscale if necessary to desirate size because most upscalers do X4 and it's often too big size to process) then send it back to VAE encode and sample it again. Like many XL users out there, I’m also new to ComfyUI and very much just a beginner in this regard. It seems a proccess similar to the one we can find in the EXTRAS Menu in Automatic1111 ComfyUI workflows for upscaling. Reload to refresh your session. txt TLDR In this tutorial, Seth introduces ComfyUI's Flux workflow, a powerful tool for AI image generation that simplifies the process of upscaling images up to 5. ultrasharp), then downscale. When I run them through 4x_NMKD-Siax_200k upscaler for example, the eyes get really glitchy / blurry / deformed, even with negative prompts in place for eyes. Best ComfyUI Upscale Workflow! (Easy ComfyUI Tutorial) 2024-04-04 12:35:00. ComfyUI Outpaint workflow Hi everyone, I've been using SD / ComfyUI for a few weeks now and I find myself overwhelmed with the number of ways to do upscaling. pth or 4x_foolhardy_Remacri. 40. 4x using consumer-grade hardware. New to Comfyui, so not an expert. Final upscale is done using an upscale model. ComfyUI manual. Swapping (Deepfake), Training Face Model & Upscaling. 2024-06-13 11:00:00. Upscale latent: The With latent upscale model you can do only 1. Then I upscale with 2xesrgan and sample the 2048x2048 again, and upscale again with 4x esrgan. The MODEL_NAME output is a string that returns the name of the Simply save and then drag and drop relevant image into your ComfyUI interface window with ControlNet Tile model installed, load image (if applicable) you want to upscale/edit, modify some prompts, press "Queue Prompt" and wait for the AI generation to complete. It efficiently manages the upscaling process by adjusting the image to the appropriate device, optimizing memory usage, and applying the upscale model in a tiled manner to prevent potential out-of-memory errors. Please keep posted images SFW. 5, euler, sgm_uniform or CNet strength 0. got prompt . Alternatively, if you want to run your own customised ComfyUI workflow, one that incorporates Ultimate SD Upscale, you can use the fofr/any-comfyui-workflow model. 6 denoise and either: Cnet strength 0. Which one is best depends on the image type, BSRGAN I find is the most general purpose, Real ESRGAN is a better choice if you want things smoother or with anime, SwinIR is a good choice for getting more detail, LDSR I would only use on more important images. And when purely upscaling, the best upscaler is called LDSR. Upscaling on larger tiles will be less detailed / more blurry and Does anyone have any suggestions, would it be better to do an iterative upscale, or how about my choice of upscale model? I have almost 20 different upscale models, and I really have no idea which might be best. 5 to get a 1024x1024 final image (512 *4*0. You should bookmark the upscaler DB, it’s the best place to look: https://openmodeldb. 1. In terms of ComfyUI nodes, the input of this node is an image, and the output is the upscaled image. These comparisons are done using ComfyUI with default node settings and fixed seeds. 4) Upscaling. Model Used: Flux model for upscaling; Unique Features: Compatible with low VRAM systems using the quantized GGUF version. If you are looking for upscale models to use you can find some on Since there are a lot of upscaling models one can use to upscale images, I thought you all might be interested in a way to compare these models, geared towards Art/Pixel Art Models. After generating my images I usually do Hires. Place the images that you want to upload in a folder Welcome to the unofficial ComfyUI subreddit. Thanks History: 16. Running Ultimate SD Upscale with Python TLDR This tutorial video guides viewers through building a basic text-to-image workflow from scratch using ComfyUI, comparing it with Stable Diffusion's automatic LL. 4x Upscale Model - Choose from a variety of 1x,2x,4x or 8x model from the https://openmodeldb. And above all, BE NICE. Here is an example: You can load this image in ComfyUI to get the workflow. My idea of this post was to provide a link four you to compare the results, so if you have a generated image you would like to upscale that you can do so with the upscaling model you liked best. 5 models in ComfyUI but they're 512x768 and as such too small resolution for my uses. Updated link to non deprecated version of efficiency nodes. The issue I think people run into is that they think the latent upscale is the same as the Latent Upscale from Auto1111. inputs. Basic latent upscale, basic upscaling via model in pixel space, with tile controlnet, with sd ultimate upscale, with LDSR, with SUPIR and whatnot. If you do 2 iterations with 1. 9 , euler_ancestral, karras. There are many options for upscaling with Automatic 1111. upscale_model. It's a bit cumbersome to get the regular ipadapter plus node to get conditioned differently for each image in a batch, Under 4K: generate base SDXL size with extras like character models or control nets -> face / hand / manual area inpainting with differential diffusion -> Ultrasharp 4x -> unsampler -> second ksampler with a mixture of inpaint and tile controlnet (I found only using tile control net blurs the image) Upscale images and remove image noise Real-ESRGAN is a machine learning model that upscales an image with minimal loss in quality. January 5, 2024 amida168 Machine Learning 0. Browse upscale Stable Diffusion & Flux models, checkpoints, hypernetworks, textual inversions, embeddings, Aesthetic Gradients, and LORAs Discover the ImageUpscaleWithModel node in ComfyUI, designed for upscaling images using a specified upscale model. Sort by: Best. I used 4x-AnimeSharp as the Welcome to the unofficial ComfyUI subreddit. Select Custom Nodes Manager The quality and resolution of these images depend on the input parameters and the upscaling model used. I was just using Sytan’s workflow with a few changes to some of the settings, and I replaced the last part of his workflow with a 2-steps upscale using the refiner model via Ultimate SD upscale like you mentioned. Took me 6 days to record but it was worth it (I think 😅) Try out fewjative/ultimate-sd-upscale, or run it with an API using our guide below. however it is very well started to use comfyui/SD local a few days ago und I wanted to know, how to get the best upscaling results. Interface. 25 upscale. The workflow is kept very simple for this test; Load image Upscale Save image. 2x, upscale using a 4x model (e. original_samples processing steps that require access to the original images. The same concepts we explored so far are valid for SDXL. 1 You must be logged So if you want 2. In the CR Upscale Image node, select the upscale_model and set the rescale_factor. Even with ControlNets, if you simply upscale and then de-noise latents, you'll get weird artifacts like the face in the bottom right instead of a teddy bear. Load Upscale Model Output Parameters: UPSCALE_MODEL I'm creating some cool images with some SD1. Iterations means how many loops you want to do. Open comment sort options Speaking of that, I This node will do the following steps: Upscale the input image with the upscale model. You signed in with another tab or window. attach to it a "latent_image" in this case it's "upscale latent" Upscale Image (using Model) node. What's the best upscale model? upvotes PSA: RealPLKSR is a new, FANTASTIC (and fast!) 4x upscaling For upscaling there are many options. Hires fix uses custom upscale models (such as those available from OpenModelDB) to increase the Do not downscale using force size, it introduces dicey pixels after upscale. This parameter does not have minimum, maximum, or default values, as it depends on the models available in your directory. Here is an example of how to use upscale models like ESRGAN. With it, I either can't get rid of visible seams, or the image is too constrained by low denoise and so lacks detail. I've eventually settled on 4x-UltraSharp as my favorite, but there are pros and cons to other choices. example usage text with workflow image u/wolowhatever we set 5 as the default but it really depends on the image and image style tbh - I tend to find that most images work well around Freedom of 3. In this ComfyUI tutorial we look at my favorite upscaler, the Ultimate SD Upscaler and it doesn't seem to get as much attention as it deserves. Adding in Iterative Mixing KSampler from the early work on DemoFusion produces far more spatially consistent results as shown in the second image. info Website. . ATM I start the first sampling in 512x512, upscale with 4x esrgan, downscale the image to 1024x1024, sample it again, like the docs tell. Tile upscaling, like ultimate upscale, is unarguably worse in raw quality / less consistent, but it's needed for many people to go above and beyond in resolutions. This guide provides a comprehensive walkthrough of the Upscale pixel and Upscale latent methods, making it a valuable resource for those looking to enhance their image As you can see, in the interface we have the following: Upscaler: This can be in the latent space or as an upscaling model; Upscale By: Basically, how much we want to enlarge the image; Hires Upscaling with Automatic 1111 WebUI. 🎨 The LDSR upscaler is a new node in ComfyUI that can provide clearer images with adjustable steps for detail. ComfyUI Upscaling is best for a dozen or so Upscales alas would take all week to do 100+. Stable Diffusion model used in this demonstration is Lyriel. The pixel images to be upscaled. I’m trying to upscale a 512x512 image which I thought wouldn’t take much VRAM looking at the Readme kijai/ComfyUI-SUPIR: SUPIR upscaling wrapper for ComfyUI github. UPSCALE_MODEL. Put the models here: ComfyUI\models\upscale_models This is often referred to as "AI Upscaling". and I’m trying to use Juggernaut V8 as my SDXL model. I don't want any changes or additions to the image, just a straightforward upscale and quality enhancement. Ultimate SD Upscale 2x and Ultimate Upscale 3x. It changes the image too much and often adds mutations. 55 Welcome to the unofficial ComfyUI subreddit. It is a node The best upscale to date for me. The Upscale Image (using Model) node can be used to upscale pixel images using a model loaded with the Load Upscale Model node. That plus how complicated the advanced KSampler is made latent too Upscaling without using ultimate upscale. Read our ComfyUI with an API guide to learn how. Works fine but. In this tutorial, we will use ComfyUI to upscale stable diffusion images to any resolution we want! We will be using a custom node pack called "Impact", which comes with many useful nodes. 2 / 4. That is using an actual SD model to do the upscaling that, afaik, doesn't yet exist in ComfyUI. A Simple ComfyUI Workflow for Video Upscaling and Interpolation. I like doing a basic first pass latent upscale before that. Today, I’m excited to share a new ComfyUI workflow that I’ve put together, which uses the Flux model to upscale any image. The workflow utilises Flux Schnell to generate the initial image and then Flux Dev to generate the higher detailed image. Upscale Model Examples. Like a simple image2image for example, with a higher resolution. I'm trying to find a way of upscaling the SD video up from its 1024x576. Examples. The model used for upscaling. To find the downscale factor in the second part, calculate by: factor = desired total upscale / fixed upscale factor = 2. You can find many more upscale models at these links. There are also other upscale models that can Welcome to the unofficial ComfyUI subreddit. i wonder if there is a good workflow for upscaling the video? I found one thread about cutting the video up in sequences and upscale from that, but dont know where to start. ComfyUI Workflow Build Text2Img + Latent Upscale + Model Upscale | ComfyUI Basics | Stable Diffusion. Really chaotic images or images that actually benefit from added details from the prompt can look exceptionally good at ~8. Reactor has built in codeformer and GFPGAN, but all the advice I've read said to avoid them. It seems that Upscayl only uses a upscaling model, so there is no difussion involved and the result will depend only on the upscaling model. This output is essential for the upscaling process as it contains the necessary data and algorithms to perform the image enhancement. Welcome to the unofficial ComfyUI subreddit. The implementation is a derivative of the Real-ESRGAN-x4plus architecture, a larger and more powerful version compared to the Real-ESRGAN-general-x4v3 architecture. Hope someone can advise. For SD 1. Put them in the models/upscale_models folder then use the UpscaleModelLoader node to load them and the ImageUpscaleWithModel node to use them. 5 denoise. info For ComfyUI portable users, move inside the "ComfyUI_windows_portable" folder. Code; Issues 93; Pull requests 3; Discussions; Is there way to get ReActor output but with high resolution like 4K? what upscaling method should i use? Beta Was this translation helpful? Give feedback. For example, if you start with a 512x512 latent empty image, then apply a 4x model, apply "upscale by" 0. 20K subscribers in the comfyui community. Upscaler Wiki - Model Database. jvahch abws imu xfwdfjf xye mugr cswe gvyjcw sknpja tiswx