Note that this post is a work in progress (wip). Maybe I will edit it a lot recently.

[Elonmusk678]

Note that this post is a work in progress (wip). Maybe I will edit it a lot recently.

---

IC-Light V2 is a series of Flux-based IC-Light models with 16ch VAE and native high resolution.

We plan to have several model variations:

• foreground conditioned model, emphasizing the preservation of input image details (this model).
• foreground conditioned model, emphasizing the ability to make large modifications like processing low-light images and change hard shadows (not released yet).
• foreground and background conditioned model (not released yet).
• integration with environment HDRIs (not released yet).

Foreground Conditioned Model

https://huggingface.co/spaces/lllyasviel/iclight-v2

Some notes:

Thanks to 16ch VAE, native high resolution, and better training methods, the detail preservation capability is much higher than SD1.5.

For example:

If you overlay the inputs/outputs, you will see the level of detail preservation, like:

another one:

Another important difference to SD1.5 is the ability to process stylized images. The SD15 IC-Light sometimes makes too large modification to image styles, like:

As you can see, the SD15 iclight makes the input drawing a photo-like image. The effect is still interesting but may not be the desired one in some cases.

Below is another attempt to add “surrealist painting of” to prompt but still cannot get a painting:

These are from new model:

(3 results with same seed 12345)

It depends on the taste of different people.

But at least the current model is finally able to give you a painting when you do not want a photo..

Examples, all with seed 12345

More info about other variations to be continued ...

Special thanks

Special thanks to FAL for the help with computation resources on many internal experiments. (I will edit this "special thanks" section later to add more items...)

Originally posted by @lllyasviel in #98