Table of Contents
2.5.0

Home

  • Lightning in 15 minutes
  • Install
  • 2.0 Upgrade Guide

Level Up

  • Basic skills
  • Intermediate skills
  • Advanced skills
  • Expert skills

Core API

  • LightningModule
  • Trainer

Optional API

  • accelerators
  • callbacks
  • cli
  • core
  • loggers
  • profiler
  • trainer
  • strategies
  • tuner
  • utilities

More

  • Community
  • Glossary
  • How-to Guides
  • Overview
  • Team management
  • Open source
    • Overview
    • PyTorch Lightning
    • Fabric
    • Lit-GPT
    • Torchmetrics
    • Litdata
    • Lit LLaMA
    • Litserve
  • Examples
  • Docs >
  • Level 12: Optimize training speed
Shortcuts

Level 12: Optimize training speed

In this level you’ll use compilers, advanced profilers and mixed precision techniques to train bigger models faster.


Speed up models by compiling them

Use torch.compile to speed up models on modern hardware

intermediate

Explore advanced mixed precision settings

Enable state-of-the-art scaling with advanced mix-precision settings.

intermediate

Enable advanced profilers

Tune model performance with profilers.

intermediate

Profile PyTorch operations

Learn to find bottlenecks in PyTorch operations.

intermediate

  • Level 12: Optimize training speed

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.