PowerPaint

[Tillerz]

Hi,

https://github.com/open-mmlab/mmagic/tree/main/projects/powerpaint

anyone know if this is a standalone thing or is this something that we could have as part of Controlnet? It has been posted in the controlnet inpaint+llama thread where they announced the inpaint+llama feature some time ago, which worked once and then broke. I really want to have a nice outpaint to fix images where stuff is cut off at one or more sides. :)

[vladmandic]

this is a separate project. anything can be integrated, but this would be massive task.

[zhuang2002]

We have recently developed a new version of PowerPaint, drawing inspiration from Brushnet. The Online Demo has been updated accordingly. In the coming days, we intend to make the model weights available as open source.

Feel free to try it out and give it a star!

The PowerPaint model possesses the ability to carry out diverse inpainting tasks, such as object insertion, object removal, shape-guided object insertion, and outpainting. Notably, we have retained the cross-attention layer that BrushNet had removed, which is essential for task prompt input.

	Object insertion	Object Removal	Shape-guided Object Insertion	Outpainting
Original Image
Output