Image-to-image is a class of generative tasks where a model transforms an input image into an output image, conditioned on the input and often a text prompt. Examples include style transfer, editing and translation between domains.

Semantic Classification

Content

  • Image-to-image generation conditions a model on an existing image to produce a modified version, ranging from changing artistic style to translating between domains such as sketches and photographs. Diffusion models perform the task by partially noising the input and denoising it under guidance from a prompt or reference.
  • Applications include editing, super-resolution, colourisation and inpainting, where part of an image is regenerated. Tools built on Stable Diffusion expose image-to-image workflows alongside text-to-image generation.

Provenance