Research
Here's a compilation of my published research work, scraped from Scholar by an agent. Some of my most popular projects and products have come out of chasing independent research ideas. I still work on them, but with the advent of LLMs, and with most research now needing a multi-GPU setup, it's been difficult to run large-scale experiments on wild ideas. I'm hopeful post-training could be a nice middle ground, and that's what I'm exploring at the moment.
Published work
Independent work
July 2026
A Little RoPE Goes a Long Way
Three weeks of RoPE experiments, then a review I designed to kill my own paper.