PyTorch 2.0 goes live with torch.compile and faster Transformers
The PyTorch team just rolled out PyTorch 2.0, introducing a major compiler revamp that boosts performance without breaking backward compatibility. The marquee feature, torch.compile, leans on OpenAI Triton to deliver an average 36% speedup under AMP precision across 165 models. Native scaled dot product attention is also baked in, eliminating the need for external FlashAttention packages.