Published:
A reconstruction of our KernelGen Challenge 9 optimization: starting from the SwiGLU backward formula, then walking through 128x128 tiling, fused INT8 quantization, memory bandwidth limits, and per-backend Triton engineering.
Published:
Starting from Attention and KV Cache, this note walks through KernelGen Challenge 8: a DeepSeek-style KV compression operator, its Triton implementation, and the separate optimization paths for GPGPU and Ascend.
Published:
A skill is crystallized consensus from repeated experience, not something designed in the abstract. Eight skills and what I learned about knowing what’s worth putting in them.
Published:
How much should I specify upfront, and how much should I let the agent figure out? Lessons from five agent projects, grounded in Anthropic’s engineering philosophy.
Published:
A single-molecule bound on cryptochrome radical pair compass sensitivity—what quantum spin dynamics tells us about the physical limits of avian magnetoreception.
Published:
docker ps returned ECONNREFUSED but the socket file existed and the daemon was running. A debugging walkthrough through pgrep, strace, and journalctl to find the root cause: zombie container state from a snap + apt dual installation.
Published:
Four research infrastructure projects, and what they taught me about failure recovery, data integrity, observability, system abstraction, and the mistakes I’d avoid starting over.
Published:
Rust concurrency notes part 3: five real-world concurrency bugs and their elegant solutions—deadlocks, data races, and performance pathologies caught at compile time.
Published:
Rust concurrency notes part 2: threads, locks, channels, and concurrency control primitives—Arc, Mutex, RwLock, Condvar, Barrier, and channel selection patterns.
Published:
Rust concurrency notes part 1: how ownership, type system, and error handling create a foundation for fearless concurrency—Send, Sync, and what the compiler actually enforces.
Published:
Models are so powerful now that anyone can bring ideas to life. But what comes after agent mania? A reflection on data flywheels, distillation, and building AI that does research.
Published:
After vibe coding comes vibe cleaning—turning a messy but working AI-generated codebase back into something a human can understand, maintain, and extend.
Published:
Notes on memory virtualization from OSTEP—address spaces, page tables, TLBs, and the mechanisms that make virtual memory work.