Diffusers documentation

ErnieImageTransformer2DModel

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v0.42.1).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

ErnieImageTransformer2DModel

Un modelo Transformer para datos similares a imágenes de ERNIE-Image.

Un modelo Transformer para datos similares a imágenes de ERNIE-Image-Turbo.

ErnieImageTransformer2DModel

clase diffusers.ErnieImageTransformer2DModel

< >

( hidden_size: int = 3072num_attention_heads: int = 24num_layers: int = 24ffn_hidden_size: int = 8192in_channels: int = 128out_channels: int = 128patch_size: int = 1text_in_dim: int = 2560rope_theta: int = 256rope_axes_dim: typing.Tuple[int, int, int] = (32, 48, 48)eps: float = 1e-06qk_layernorm: bool = True )

forward

< >

( hidden_states: Tensortimestep: Tensortext_bth: Tensortext_lens: Tensorreturn_dict: bool = True )

Parámetros

  • hidden_states (torch.Tensor de forma (batch_size, in_channels, height, width)) — Entrada hidden_states.
  • timestep (torch.LongTensor) — Se utiliza para indicar el paso de desruido.
  • text_bth (torch.Tensor) — Embeddings de texto condicionales (embeddings calculados a partir de las condiciones de entrada, como los prompts) a utilizar, con forma (batch_size, text_length, embed_dims).
  • text_lens (torch.Tensor) — Longitudes de las secuencias de texto por muestra, utilizadas para construir la máscara de atención.
  • return_dict (bool, opcional, valor predeterminado True) — Indica si se debe devolver un ~models.transformer_2d.Transformer2DModelOutput en lugar de una tupla simple.

El método forward de ErnieImageTransformer2DModel.

Update on GitHub