Instructions to use lsmpp/kontextrefiner with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use lsmpp/kontextrefiner with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("lsmpp/kontextrefiner", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Single files
The [~loaders.FromSingleFileMixin.from_single_file] method allows you to load:
- a model stored in a single file, which is useful if you're working with models from the diffusion ecosystem, like Automatic1111, and commonly rely on a single-file layout to store and share models
- a model stored in their originally distributed layout, which is useful if you're working with models finetuned with other services, and want to load it directly into Diffusers model objects and pipelines
Read the Model files and layouts guide to learn more about the Diffusers-multifolder layout versus the single-file layout, and how to load models stored in these different layouts.
Supported pipelines
- [
StableDiffusionPipeline] - [
StableDiffusionImg2ImgPipeline] - [
StableDiffusionInpaintPipeline] - [
StableDiffusionControlNetPipeline] - [
StableDiffusionControlNetImg2ImgPipeline] - [
StableDiffusionControlNetInpaintPipeline] - [
StableDiffusionUpscalePipeline] - [
StableDiffusionXLPipeline] - [
StableDiffusionXLImg2ImgPipeline] - [
StableDiffusionXLInpaintPipeline] - [
StableDiffusionXLInstructPix2PixPipeline] - [
StableDiffusionXLControlNetPipeline] - [
StableDiffusionXLKDiffusionPipeline] - [
StableDiffusion3Pipeline] - [
LatentConsistencyModelPipeline] - [
LatentConsistencyModelImg2ImgPipeline] - [
StableDiffusionControlNetXSPipeline] - [
StableDiffusionXLControlNetXSPipeline] - [
LEditsPPPipelineStableDiffusion] - [
LEditsPPPipelineStableDiffusionXL] - [
PIAPipeline]
Supported models
- [
UNet2DConditionModel] - [
StableCascadeUNet] - [
AutoencoderKL] - [
ControlNetModel] - [
SD3Transformer2DModel] - [
FluxTransformer2DModel]
FromSingleFileMixin
[[autodoc]] loaders.single_file.FromSingleFileMixin
FromOriginalModelMixin
[[autodoc]] loaders.single_file_model.FromOriginalModelMixin