Hyper Stable Diffusion with Blender & any 3D software in real time - SD Experimental
Andrea Baioni Andrea Baioni
3.49K subscribers
45,903 views
0

 Published On Apr 29, 2024

If only there was a way to generate images in real time with Stable Diffusion and any 3D software! Wait, there is?
I guess it depends on how much jank you can handle.

Today we'll be implementing a way to generate images with either Hyper SD or SDXL Lightning by sourcing an image directly from the viewport of any 3D app.

If you like my contributions, you can buy me a coffee here: https://ko-fi.com/risunobushi

Useful links:
- Hyper SDXL workflow: https://openart.ai/workflows/3ywJV6S8...
- SDXL Lightning workflow: https://openart.ai/workflows/avGFtKiq...

- Hyper SD models: https://huggingface.co/ByteDance/Hype...
- Juggernaut SDXL Lightning model: https://civitai.com/models/133005/jug...

- Screenshare node (MixLab suite) github: https://github.com/shadowcz007/comfyu...
- Popup Preview node github: https://github.com/NimaNzrii/comfyui-...
- Depth Anything and other ControlNet Auxiliary nodes github: https://github.com/Fannovel16/comfyui...

Timestamps:
00:00 - Intro
02:02 - Screen Share Node overview
03:49 - Installing the required nodes and models
07:12 - Hyper SDXL workflow walkthrough
11:59 - SDXL Lightning workflow walkthrough
13:19 - Testing Blender x SDXL Lightning in real time
18:54 - Testing Blender x Hyper SDXL in real time
21:15 - More Testing with Popup Preview node
22:33 - Final Considerations and Outro

#stablediffusion #mixamo #blender #controlnet #adobemixamo #stablediffusiontutorial #ai #generativeai #generativeart #comfyui #comfyuitutorial #sdxllightning #3d #2d #illustration #render #risunobushi_ai #sdxl #sd #risunobushi #andreabaioni

show more

Share/Embed