Image-to-Image
Diffusers
English
stable-diffusion
stable-diffusion-diffusers
text-to-image
diffusers-training
Instructions to use SherryXTChen/InstructCLIP-InstructPix2Pix with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SherryXTChen/InstructCLIP-InstructPix2Pix with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SherryXTChen/InstructCLIP-InstructPix2Pix", dtype=torch.bfloat16, device_map="cuda") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
End of training
Browse files
README.md
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: timbrooks/instruct-pix2pix
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
license: creativeml-openrail-m
|
| 5 |
+
tags:
|
| 6 |
+
- stable-diffusion
|
| 7 |
+
- stable-diffusion-diffusers
|
| 8 |
+
- text-to-image
|
| 9 |
+
- diffusers
|
| 10 |
+
- diffusers-training
|
| 11 |
+
- lora
|
| 12 |
+
inference: true
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
<!-- This model card has been generated automatically according to the information the training script had access to. You
|
| 16 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 17 |
+
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
|
| 21 |
+
## Intended uses & limitations
|
| 22 |
+
|
| 23 |
+
#### How to use
|
| 24 |
+
|
| 25 |
+
```python
|
| 26 |
+
# TODO: add an example code snippet for running this diffusion pipeline
|
| 27 |
+
```
|
| 28 |
+
|
| 29 |
+
#### Limitations and bias
|
| 30 |
+
|
| 31 |
+
[TODO: provide examples of latent issues and potential remediations]
|
| 32 |
+
|
| 33 |
+
## Training details
|
| 34 |
+
|
| 35 |
+
[TODO: describe the data used to train the model]
|
checkpoint-15000/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ec534ec03dbc8e104b9cf3500a091eea304d20c7d7bc88b315419120de2f3021
|
| 3 |
+
size 51234426
|
checkpoint-15000/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8038c520d2d45be36ead24432a16088b8abf5921fe7ff7510373a65b8f79d242
|
| 3 |
+
size 25548064
|
checkpoint-15000/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ffc4a99cb04b8937d979ca6939725af26b45fc7eaacac51dcb5ab077a260df40
|
| 3 |
+
size 14344
|
checkpoint-15000/scaler.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2491380f0b55e3e8cbfec1654220a94cf6d79d50cd1b1e51dfe593c04a274cb9
|
| 3 |
+
size 988
|
checkpoint-15000/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb5488e48edf134f11b30bc97f9db87ef384ca8eea75a0471520f372e45b82a0
|
| 3 |
+
size 1000
|
pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8038c520d2d45be36ead24432a16088b8abf5921fe7ff7510373a65b8f79d242
|
| 3 |
+
size 25548064
|