Optimization Examples

Source examples/inference/optimizations.

Optimization Examples#

python examples/inference/optimizations/attention_example.py
python examples/inference/optimizations/teacache_example.py

Example materials#