Writing

Blog

Research notes, postmortems, and long-form explanations — mostly ML systems, computer vision, and the occasional hard-won lesson.

July 2026 · ~18 min

A Little RoPE, a Lot of Prior Art

Three weeks of controlled RoPE-for-CLIP experiments, one adversarial literature review, and the ICLR 2025 paper that had already published my headline result. Includes a full primer on rotary position embeddings, the SigLIP loss, and NTK-aware length extrapolation.