diffusers/pr_11636/en/api/modular_diffusers/pipeline_components.md

Components and configs

ComponentSpec[[diffusers.ComponentSpec]]

diffusers.ComponentSpec[[diffusers.ComponentSpec]]

Source

Specification for a pipeline component.

A component can be created in two ways:

1. From scratch using init with a config dict
2. using from_pretrained

creatediffusers.ComponentSpec.createhttps://github.com/huggingface/diffusers/blob/vr_11636/src/diffusers/modular_pipelines/modular_pipeline_utils.py#L241[{"name": "config", "val": ": typing.Union[diffusers.configuration_utils.FrozenDict, typing.Dict[str, typing.Any], NoneType] = None"}, {"name": "**kwargs", "val": ""}] Create component using from_config with config.

Parameters:

name : Name of the component

type_hint : Type of the component (e.g. UNet2DConditionModel)

description : Optional description of the component

config : Optional config dict for init creation

pretrained_model_name_or_path : Optional pretrained_model_name_or_path path for from_pretrained creation

subfolder : Optional subfolder in pretrained_model_name_or_path

variant : Optional variant in pretrained_model_name_or_path

revision : Optional revision in pretrained_model_name_or_path

default_creation_method : Preferred creation method - "from_config" or "from_pretrained"

decode_load_id[[diffusers.ComponentSpec.decode_load_id]]

Source

Decode a load_id string back into a dictionary of loading fields and values.

Parameters:

load_id : The load_id string to decode, format: "pretrained_model_name_or_path|subfolder|variant|revision" where None values are represented as "null"

Returns:

Dict mapping loading field names to their values. e.g. { "pretrained_model_name_or_path": "path/to/repo", "subfolder": "subfolder", "variant": "variant", "revision": "revision" } If a segment value is "null", it's replaced with None. Returns None if load_id is "null" (indicating component not created with load method).

from_component[[diffusers.ComponentSpec.from_component]]

Source

Create a ComponentSpec from a Component.

Currently supports:

• Components created with ComponentSpec.load() method
• Components that are ConfigMixin subclasses but not nn.Modules (e.g. schedulers, guiders)

Parameters:

name : Name of the component

component : Component object to create spec from

Returns:

ComponentSpec object

load[[diffusers.ComponentSpec.load]]

Source

Load component using from_pretrained.

loading_fields[[diffusers.ComponentSpec.loading_fields]]

Source

Return the names of all loading‐related fields (i.e. those whose field.metadata["loading"] is True).

ConfigSpec[[diffusers.modular_pipelines.ConfigSpec]]

diffusers.modular_pipelines.ConfigSpec[[diffusers.modular_pipelines.ConfigSpec]]

Source

Specification for a pipeline configuration parameter.

ComponentsManager[[diffusers.ComponentsManager]]

diffusers.ComponentsManager[[diffusers.ComponentsManager]]

Source

A central registry and management system for model components across multiple pipelines.

ComponentsManager provides a unified way to register, track, and reuse model components (like UNet, VAE, text encoders, etc.) across different modular pipelines. It includes features for duplicate detection, memory management, and component organization.

> This is an experimental feature and is likely to change in the future.

Example:

from diffusers import ComponentsManager

# Create a components manager
cm = ComponentsManager()

# Add components
cm.add("unet", unet_model, collection="sdxl")
cm.add("vae", vae_model, collection="sdxl")

# Enable auto offloading
cm.enable_auto_cpu_offload()

# Retrieve components
unet = cm.get_one(name="unet", collection="sdxl")

adddiffusers.ComponentsManager.addhttps://github.com/huggingface/diffusers/blob/vr_11636/src/diffusers/modular_pipelines/components_manager.py#L378[{"name": "name", "val": ": str"}, {"name": "component", "val": ": typing.Any"}, {"name": "collection", "val": ": typing.Optional[str] = None"}]- name (str) -- The name of the component

• component (Any) -- The component to add
• collection (Optional[str]) -- The collection to add the component to0strThe unique component ID, which is generated as "{name}_{id(component)}" where id(component) is Python's built-in unique identifier for the object

Add a component to the ComponentsManager.

Parameters:

name (str) : The name of the component

component (Any) : The component to add

collection (Optional[str]) : The collection to add the component to

Returns:

str

The unique component ID, which is generated as "{name}_{id(component)}" where id(component) is Python's built-in unique identifier for the object

disable_auto_cpu_offload[[diffusers.ComponentsManager.disable_auto_cpu_offload]]

Source

Disable automatic CPU offloading for all components.

enable_auto_cpu_offload[[diffusers.ComponentsManager.enable_auto_cpu_offload]]

Source

Enable automatic CPU offloading for all components.

The algorithm works as follows:

1. All models start on CPU by default
2. When a model's forward pass is called, it's moved to the execution device
3. If there's insufficient memory, other models on the device are moved back to CPU
4. The system tries to offload the smallest combination of models that frees enough memory
5. Models stay on the execution device until another model needs memory and forces them off

Parameters:

device (Union[str, int, torch.device]) : The execution device where models are moved for forward passes

memory_reserve_margin (str) : The memory reserve margin to use, default is 3GB. This is the amount of memory to keep free on the device to avoid running out of memory during model execution (e.g., for intermediate activations, gradients, etc.)

get_components_by_ids[[diffusers.ComponentsManager.get_components_by_ids]]

Source

Get components by a list of IDs.

Parameters:

ids (List[str]) : List of component IDs

return_dict_with_names (Optional[bool]) : Whether to return a dictionary with component names as keys:

Returns:

Dict[str, Any]

Dictionary of components.

• If return_dict_with_names=True, keys are component names.
• If return_dict_with_names=False, keys are component IDs.

get_components_by_names[[diffusers.ComponentsManager.get_components_by_names]]

Source

Get components by a list of names, optionally filtered by collection.

Parameters:

names (List[str]) : List of component names

collection (Optional[str]) : Optional collection to filter by

Returns:

Dict[str, Any]

Dictionary of components with component names as keys

get_ids[[diffusers.ComponentsManager.get_ids]]

Source

Get component IDs by a list of names, optionally filtered by collection.

Parameters:

names (Union[str, List[str]]) : List of component names

collection (Optional[str]) : Optional collection to filter by

Returns:

List[str]

List of component IDs

get_model_info[[diffusers.ComponentsManager.get_model_info]]

Source

Get comprehensive information about a component.

Parameters:

component_id (str) : Name of the component to get info for

fields (Optional[Union[str, List[str]]]) : Field(s) to return. Can be a string for single field or list of fields. If None, uses the available_info_fields setting.

Returns:

Dictionary containing requested component metadata. If fields is specified, returns only those fields. Otherwise, returns all fields.

get_one[[diffusers.ComponentsManager.get_one]]

Source

Get a single component by either:

• searching name (pattern matching), collection, or load_id.
• passing in a component_id Raises an error if multiple components match or none are found.

Parameters:

component_id (Optional[str]) : Optional component ID to get

name (Optional[str]) : Component name or pattern

collection (Optional[str]) : Optional collection to filter by

load_id (Optional[str]) : Optional load_id to filter by

Returns:

A single component

remove[[diffusers.ComponentsManager.remove]]

Source

Remove a component from the ComponentsManager.

Parameters:

component_id (str) : The ID of the component to remove

remove_from_collection[[diffusers.ComponentsManager.remove_from_collection]]

Source

Remove a component from a collection.

search_components[[diffusers.ComponentsManager.search_components]]

Source

Search components by name with simple pattern matching. Optionally filter by collection or load_id.

Parameters:

names : Component name(s) or pattern(s) Patterns: - "unet" : match any component with base name "unet" (e.g., unet_123abc) - "!unet" : everything except components with base name "unet" - "unet*" : anything with base name starting with "unet" - "!unet*" : anything with base name NOT starting with "unet" - "unet" : anything with base name containing "unet" - "!unet" : anything with base name NOT containing "unet" - "refiner|vae|unet" : anything with base name exactly matching "refiner", "vae", or "unet" - "!refiner|vae|unet" : anything with base name NOT exactly matching "refiner", "vae", or "unet" - "unet*|vae*" : anything with base name starting with "unet" OR starting with "vae"

collection : Optional collection to filter by

load_id : Optional load_id to filter by

return_dict_with_names : If True, returns a dictionary with component names as keys, throw an error if multiple components with the same name are found If False, returns a dictionary with component IDs as keys

Returns:

Dictionary mapping component names to components if return_dict_with_names=True, or a dictionary mapping component IDs to components if return_dict_with_names=False

InsertableDict[[diffusers.modular_pipelines.InsertableDict]]

diffusers.modular_pipelines.InsertableDict[[diffusers.modular_pipelines.InsertableDict]]

Source