Skip to content

FastVideo

training

Initializing search

hao-ai-lab/FastVideo

Home
Getting Started
Inference
Training
Distillation
Sliding Tile Attention
Video Sparse Attention
Design
Developer Guide
API Reference

FastVideo

hao-ai-lab/FastVideo

Home
Getting Started
Getting Started
Inference
Inference
- Quick Start
- Configuration
- Optimizations
- ComfyUI
- Support Matrix
- CLI
- Add Pipeline
- Examples
  Examples
Training
Training
- Data Preprocessing
- Fine-tuning
- Examples
  Examples
Distillation
Distillation
- Data Preprocessing
- DMD
Sliding Tile Attention
Sliding Tile Attention
- Installation
- Demo
Video Sparse Attention
Video Sparse Attention
- Installation
Design
Design
- Overview
Developer Guide
Developer Guide
- Overview
- Developer Environment
  Developer Environment
  - Index
  - Docker
  - RunPod
- Profiling
API Reference
API Reference
- FastVideo
- fastvideo
  fastvideo
  - fastvideo
  - attention
    attention
    
    attention
    
    backends
    backends
    
    backends
    
    STA_configuration
    
    abstract
    
    flash_attn
    
    sage_attn
    
    sage_attn3
    
    sdpa
    
    sliding_tile_attn
    
    video_sparse_attn
    
    vmoba
    
    layer
    
    selector
  - configs
    configs
    
    configs
    
    configs
    
    models
    models
    
    models
    
    base
    
    dits
    dits
    
    dits
    
    base
    
    cosmos
    
    hunyuanvideo
    
    stepvideo
    
    wanvideo
    
    encoders
    encoders
    
    encoders
    
    base
    
    clip
    
    llama
    
    t5
    
    vaes
    vaes
    
    vaes
    
    base
    
    cosmosvae
    
    hunyuanvae
    
    stepvideovae
    
    wanvae
    
    pipelines
    pipelines
    
    pipelines
    
    base
    
    cosmos
    
    hunyuan
    
    registry
    
    stepvideo
    
    wan
    
    sample
    sample
    
    sample
    
    base
    
    cosmos
    
    hunyuan
    
    registry
    
    stepvideo
    
    teacache
    
    wan
    
    utils
  - dataset
    dataset
    
    dataset
    
    latent_datasets
    
    parquet_dataset_iterable_style
    
    parquet_dataset_map_style
    
    preprocessing_datasets
    
    transform
    
    upload_to_hf
    
    utils
    
    validation_dataset
  - distributed
    distributed
    
    distributed
    
    communication_op
    
    device_communicators
    device_communicators
    
    device_communicators
    
    base_device_communicator
    
    cpu_communicator
    
    cuda_communicator
    
    npu_communicator
    
    pyhccl
    
    pyhccl_wrapper
    
    pynccl
    
    pynccl_wrapper
    
    parallel_state
    
    utils
  - entrypoints
    entrypoints
    
    entrypoints
    
    cli
    cli
    
    cli
    
    cli_types
    
    generate
    
    main
    
    utils
    
    video_generator
  - envs
  - fastvideo_args
  - forward_context
  - image_processor
  - layers
    layers
    
    layers
    
    activation
    
    custom_op
    
    layernorm
    
    linear
    
    mlp
    
    quantization
    quantization
    
    quantization
    
    base_config
    
    rotary_embedding
    
    utils
    
    visual_embedding
    
    vocab_parallel_embedding
  - logger
  - logging_utils
    logging_utils
    
    logging_utils
    
    formatter
  - models
    models
    
    models
    
    hf_transformer_utils
    
    loader
    loader
    
    loader
    
    component_loader
    
    fsdp_load
    
    utils
    
    weight_utils
    
    parameter
    
    registry
    
    utils
    
    vision_utils
  - pipelines
    pipelines
    
    pipelines
    
    basic
    basic
    
    basic
    
    cosmos
    cosmos
    
    cosmos
    
    cosmos_pipeline
    
    hunyuan
    hunyuan
    
    hunyuan
    
    hunyuan_pipeline
    
    stepvideo
    stepvideo
    
    stepvideo
    
    stepvideo_pipeline
    
    wan
    wan
    
    wan
    
    wan_causal_dmd_pipeline
    
    wan_dmd_pipeline
    
    wan_i2v_dmd_pipeline
    
    wan_i2v_pipeline
    
    wan_pipeline
    
    wan_v2v_pipeline
    
    composed_pipeline_base
    
    lora_pipeline
    
    pipeline_batch_info
    
    pipeline_registry
    
    preprocess
    preprocess
    
    preprocess
    
    preprocess_pipeline_base
    
    preprocess_pipeline_i2v
    
    preprocess_pipeline_ode_trajectory
    
    preprocess_pipeline_t2v
    
    preprocess_pipeline_text
    
    preprocess_stages
    
    v1_preprocess
    
    v1_preprocessing_new
    
    wan
    wan
    
    wan
    
    wan_preprocess_pipelines
    
    stages
    stages
    
    stages
    
    base
    
    causal_denoising
    
    conditioning
    
    decoding
    
    denoising
    
    encoding
    
    image_encoding
    
    input_validation
    
    latent_preparation
    
    stepvideo_encoding
    
    text_encoding
    
    timestep_preparation
    
    utils
    
    validators
    
    training
  - platforms
    platforms
    
    platforms
    
    cpu
    
    cuda
    
    interface
    
    mps
    
    npu
    
    rocm
  - profiler
  - tests
    tests
    
    tests
    
    conftest
    
    utils
  - third_party
    third_party
    
    third_party
    
    pynvml
  - training
    training
    
    training
    
    activation_checkpoint
    
    checkpointing_utils
    
    distillation_pipeline
    
    ode_causal_pipeline
    
    self_forcing_distillation_pipeline
    
    trackers
    
    training_pipeline
    
    training_utils
    
    wan_distillation_pipeline
    
    wan_i2v_distillation_pipeline
    
    wan_i2v_training_pipeline
    
    wan_self_forcing_distillation_pipeline
    
    wan_training_pipeline
  - utils
  - version
  - worker
    worker
    
    worker
    
    executor
    
    gpu_worker
    
    multiproc_executor
    
    ray_distributed_executor
    
    ray_env
    
    ray_utils
    
    worker_base
  - workflow
    workflow
    
    workflow
    
    preprocess
    preprocess
    
    preprocess
    
    components
    
    preprocess_workflow
    
    preprocess_workflow_i2v
    
    preprocess_workflow_t2v
    
    workflow_base

training ¶

Training pipelines for fastvideo.v1.

This package contains pipelines for training diffusion models.

Made with Material for MkDocs