SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations

SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations

Category: Deep Learning
License: MIT
Model Type: Image Editing
SDEdit is a PyTorch-based framework for image synthesis and editing that leverages stochastic differential equations (SDEs) to guide the generation process. By introducing controlled noise to an input image and then denoising it using a diffusion model, SDEdit enables realistic and faithful image transformations without the need for task-specific training or GAN inversions.

Key Features

  • Stroke-Based Image Synthesis: Generate realistic images from user-provided sketches or strokes.
  • Image Editing: Modify existing images guided by user inputs, such as colored strokes or patches.
  • Image Compositing: Combine elements from multiple images into a cohesive, realistic output.
  • Plug-and-Play: Compatible with pre-trained diffusion models without additional training.
  • High Fidelity and Realism: Achieves superior results in terms of realism and user satisfaction compared to GAN-based methods.

Project Screenshots

Project Screenshot
Project Screenshot
Project Screenshot
Project Screenshot