| # stable-diffusion-webui-non-prompt-travel (extensions) |
|
|
| Of course not only prompts! -- You shall also be able to travel through any other conditions. 😀 |
| |
| ---- |
|
|
| ### ControlNet-Travel |
|
|
| Travel through ControlNet's control conditions like canny, depth, openpose, etc... |
|
|
| ⚠Memory (not VRAM) usage grows linearly with sampling steps, and fusion layers count, this is its nature 😥 |
|
|
| Quickstart instructions: |
|
|
| - prepare a folder of images, might be frames from a video |
| - check enble `sd-webui-controlnet`, set all parameters as you want, but it's ok to **leave the ref image box empty** |
| - reference images will be read from the image folder given in controlnet-travel :) |
| - find `ControlNet Travel` in the script dropdown, set all parameters again, specify your image folder path here |
| - click Generate button |
|
|
| Options: |
|
|
| - interp_meth: (categorical) |
| - `linear`: linear weighted sum, better for area-based annotaions like `depth`, `seg` |
| - `rife`: optical flow model (requires to install postprocess tools first), better for edge-base annotaions like `canny`, `openpose` |
| - skip_latent_fusion: (list of bool), experimental |
| - skip some latent layers fusion for saving memory, but might get wierd results 🤔 |
| - ℹ in my experiences, the `mid` and `in` blocks are more safe to skip |
| - save_rife: (bool), save the rife interpolated condtion images |
|
|
|
|
| ---- |
| by Armit |
| 2023/04/12 |
|
|
