What is Inpainting in AI and how to use it?

What is Inpainting in AI and how to use it?

What is Inpainting in AI?

Inpainting is a technique of filling in missing regions of images that involves filling in the missing or damaged parts of an image, or removing the undesired object to construct a complete image.

However with the power of AI and the Stable Diffusion model, inpainting can be used not just for restoring missing or flawed parts of the image but also for rendering something entirely new in any part of an existing image.

How to use Inpainting in NightCafe

Inpainting refers to masking your start image such that only a specific part of it gets affected by your prompt.

Inpainting is currently experimental - not everything works out well, so please be ready for some disappointing results. However we've found that it works well when evolving a creation in a workflow like the below.

  1. Create something using the "Stable" algorithm (without a start image or inpainting for now). E.g. "Portrait of a Llama, trending on Artstation".

  2. Evolve the finished version, change the prompt to "Portrait of a Llama wearing a beret, trending on Artstation". Then, create a mask by drawing over the Llama's head where the beret should go. Click "Create" and wait for it to finish.

  3. Repeat as many times as you like, adding or changing details by editing the prompt and mask each time.

Note: when you create a mask, it's saved to the particular start image you used, so you can reuse it again in the future without having to recreate it.

    • Related Articles

    • What are prompts and how to use them?

      What are prompts? Generative AI prompts are written or visual cues, words or sentences, that tell AI Art Generators what kind of image you want them to create. Prompt fundamentals In order to produce graphics with a specific style, the text prompts ...
    • Inpainting on NightCafe

      Original article by creator @Weresl0th. Big thanks from the NightCafe team! What is Inpainting in AI Image Generation? Inpainting is a technique of changing an image that involves filling in the missing or undesired parts of the image, or removing ...
    • The Artistic algorithm - VQGAN+CLIP text-to-image AI Art Generator

      The Artistic algorithm is the original text-to-image AI art algorithm. Its' technical name is "VQGAN+CLIP". It is great at producing beautiful textures and scenery based on descriptive keywords (modifiers), however the images often don't seem to ...
    • How to permanently delete a creation?

      You can permanently delete a creation from the My Creations page (make sure you are on My creations page not your Profile page): 1. Click on the three-dot menu of the creation. 2. Choose Delete permanently Delete creation permanently You can see how ...
    • How to archive a creation

      1. To archive a creation, from the main menu bar choose My creations page. 2. Find the creation you want to archive, then hover over the creation and click the tree dots icon, and choose Archive. How to bulk archive/delete creations 1. To archive ...