layerwise_offload

Classes

fastvideo.hooks.layerwise_offload.LayerwiseOffloadHook

LayerwiseOffloadHook(state: LayerwiseOffloadState)

Bases: ForwardHook

A hook that enables layerwise CPU offloading during forward pass.

Source code in fastvideo/hooks/layerwise_offload.py

def __init__(self, state: LayerwiseOffloadState) -> None:
    self.state = state

Functions