Skip to content
FastVideo
sage_attn3
Initializing search
hao-ai-lab/FastVideo
Home
Getting Started
Inference
Training
Distillation
Sliding Tile Attention
Video Sparse Attention
Design
Developer Guide
API Reference
FastVideo
hao-ai-lab/FastVideo
Home
Getting Started
Getting Started
Installation
Quick Start
V1 API
Inference
Inference
Quick Start
Configuration
Optimizations
ComfyUI
Support Matrix
CLI
Add Pipeline
Examples
Examples
Basic
Optimizations
STA Mask Search
Training
Training
Data Preprocessing
Fine-tuning
Examples
Examples
Training Index
Wan T2V 1.3B
Wan I2V 14B 480p
Wan2.1 Fun 1.3B InP
Wan2.1 VSA
Fine-tuning
Distillation
Distillation
Data Preprocessing
DMD
Sliding Tile Attention
Sliding Tile Attention
Installation
Demo
Video Sparse Attention
Video Sparse Attention
Installation
Design
Design
Overview
Developer Guide
Developer Guide
Overview
Developer Environment
Developer Environment
Index
Docker
RunPod
Profiling
API Reference
API Reference
FastVideo
fastvideo
fastvideo
fastvideo
attention
attention
attention
backends
backends
backends
STA_configuration
abstract
flash_attn
sage_attn
sage_attn3
sage_attn3
Table of contents
Classes
Functions
sdpa
sliding_tile_attn
video_sparse_attn
vmoba
layer
selector
configs
configs
configs
configs
models
models
models
base
dits
dits
dits
base
cosmos
hunyuanvideo
stepvideo
wanvideo
encoders
encoders
encoders
base
clip
llama
t5
vaes
vaes
vaes
base
cosmosvae
hunyuanvae
stepvideovae
wanvae
pipelines
pipelines
pipelines
base
cosmos
hunyuan
registry
stepvideo
wan
sample
sample
sample
base
cosmos
hunyuan
registry
stepvideo
teacache
wan
utils
dataset
dataset
dataset
latent_datasets
parquet_dataset_iterable_style
parquet_dataset_map_style
preprocessing_datasets
transform
upload_to_hf
utils
validation_dataset
distributed
distributed
distributed
communication_op
device_communicators
device_communicators
device_communicators
base_device_communicator
cpu_communicator
cuda_communicator
npu_communicator
pyhccl
pyhccl_wrapper
pynccl
pynccl_wrapper
parallel_state
utils
entrypoints
entrypoints
entrypoints
cli
cli
cli
cli_types
generate
main
utils
video_generator
envs
fastvideo_args
forward_context
image_processor
layers
layers
layers
activation
custom_op
layernorm
linear
mlp
quantization
quantization
quantization
base_config
rotary_embedding
utils
visual_embedding
vocab_parallel_embedding
logger
logging_utils
logging_utils
logging_utils
formatter
models
models
models
hf_transformer_utils
loader
loader
loader
component_loader
fsdp_load
utils
weight_utils
parameter
registry
utils
vision_utils
pipelines
pipelines
pipelines
basic
basic
basic
cosmos
cosmos
cosmos
cosmos_pipeline
hunyuan
hunyuan
hunyuan
hunyuan_pipeline
stepvideo
stepvideo
stepvideo
stepvideo_pipeline
wan
wan
wan
wan_causal_dmd_pipeline
wan_dmd_pipeline
wan_i2v_dmd_pipeline
wan_i2v_pipeline
wan_pipeline
wan_v2v_pipeline
composed_pipeline_base
lora_pipeline
pipeline_batch_info
pipeline_registry
preprocess
preprocess
preprocess
preprocess_pipeline_base
preprocess_pipeline_i2v
preprocess_pipeline_ode_trajectory
preprocess_pipeline_t2v
preprocess_pipeline_text
preprocess_stages
v1_preprocess
v1_preprocessing_new
wan
wan
wan
wan_preprocess_pipelines
stages
stages
stages
base
causal_denoising
conditioning
decoding
denoising
encoding
image_encoding
input_validation
latent_preparation
stepvideo_encoding
text_encoding
timestep_preparation
utils
validators
training
platforms
platforms
platforms
cpu
cuda
interface
mps
npu
rocm
profiler
tests
tests
tests
conftest
utils
third_party
third_party
third_party
pynvml
training
training
training
activation_checkpoint
checkpointing_utils
distillation_pipeline
ode_causal_pipeline
self_forcing_distillation_pipeline
trackers
training_pipeline
training_utils
wan_distillation_pipeline
wan_i2v_distillation_pipeline
wan_i2v_training_pipeline
wan_self_forcing_distillation_pipeline
wan_training_pipeline
utils
version
worker
worker
worker
executor
gpu_worker
multiproc_executor
ray_distributed_executor
ray_env
ray_utils
worker_base
workflow
workflow
workflow
preprocess
preprocess
preprocess
components
preprocess_workflow
preprocess_workflow_i2v
preprocess_workflow_t2v
workflow_base
Table of contents
Classes
Functions
sage_attn3
¶
Classes
¶
Functions
¶