Software & Data Downloads — SteeredDiffusion

This the code for the ICCV 2023 publication Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Face Synthesis. It allows users to modify outputs of pretrained diffusion models using additional steering functions without any need of fine-tuning. The code shows examples of several types of tasks like image restoration and editing using Steered Diffusion.

• MERL Contacts

  • 

    Tim K.
    Marks
     

  • 

    Anoop
    Cherian
     

  • 

    Suhas
    Lohit
     

  • 

    Ye
    Wang
     

  • 

    Toshiaki
    Koike-Akino
     

• Related Research Highlight

  • Steered Diffusion

• Related Publications

   Nair, N.G., Cherian, A., Lohit, S., Wang, Y., Koike-Akino, T., Patel, V.M., Marks, T.K., "Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis", IEEE International Conference on Computer Vision (ICCV), October 2023, pp. 20850-20860.

  BibTeX TR2023-126 PDF Software Presentation

  • @inproceedings{Nair2023sep,
  • author = {Nair, Nithin Gopalakrishnan and Cherian, Anoop and Lohit, Suhas and Wang, Ye and Koike-Akino, Toshiaki and Patel, Vishal M. and Marks, Tim K.},
  • title = {{Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis}},
  • booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision},
  • year = 2023,
  • pages = {20850--20860},
  • month = oct,
  • publisher = {IEEE/CVF},
  • url = {https://www.merl.com/publications/TR2023-126}
  • }



Software & Data Downloads

Access software at https://github.com/merlresearch/SteeredDiffusion.