Musings by S Akash

RL Didn't Teach Your Model to Think

Aug 2, 2026
Paper PresentationReinforcement LearningReasoning

I started the ML Reading Club NCR in Noida (venue partner: Lyric), and gave the first session's talk on the NeurIPS 2025 paper asking whether RL with verifiable rewards teaches models anything new. The pass@k crossover says no: RL sharpens the base model's distribution, it does not expand it. Slides included.

Read more

The Best KV Cache Eviction Is the One You Never Have to Do

Jun 30, 2026
ML SystemsAttentionInference

I do KV-cache eviction for a living. An OCR report out of Baidu, R-SWA, bounds the decoder to the last 128 generated tokens, keeps the cache constant, and gets higher accuracy for it. Here is why that quietly reframes the whole eviction problem for reference-grounded tasks.

Read more

Can C++26 Reflection Pick Your GPU at Runtime?

Jun 18, 2026
C++GPU ComputingCompilers

C++26 reflection collapses every program entity into one scalar handle, std::meta::info. I ask whether you can steal that trick to select a GPU backend at runtime, and stay honest about why the host/device gap does not vanish.

Read more

Attention Mechanisms That Actually Matter: From Multi-Head to PagedAttention

Mar 25, 2026
ML SystemsGPU Computing

A deep dive into four attention mechanisms that power modern LLMs, from the original transformer to the serving tricks that make inference feasible at scale.

Read more

How Shazam Identifies a Song in 10 Seconds (The Math Is Beautiful)

Mar 24, 2026
Signal ProcessingEssay

A 20 year old paper turned an intractable search problem into a hash table lookup. Fourier transforms, constellation maps, and the most elegant algorithm I have ever encountered.

Read more

Dyson Spheres and the Kardashev Scale: Engineering at the Scale of Stars

Mar 23, 2026
ScienceEssay

What it means to harness a star's full output, why Dyson Spheres are the defining structure of a Type II civilization, and where humanity sits on the Kardashev Scale right now.

Read more

NVIDIA GPU Architectures: Ampere to Blackwell, Through a Kernel Developer's Eyes

Mar 22, 2026
GPU ComputingCUDA

Four generations of NVIDIA GPUs, from the perspective of someone who actually writes the kernels that run on them. What the specs mean when you are profiling at 2am.

Read more

To Climb the Kardashev Scale, We Need AI That Thinks Like Terence Tao

Mar 21, 2026
EssayAITechnology

Why civilizational scale engineering challenges require not one brilliant mind but thousands working simultaneously, and why that means superhuman AI is not optional.

Read more

I Built gpucheck Because GPU Kernel Testing Shouldn't Feel Like Guesswork

Mar 20, 2026
Open SourceGPU Computing

The story behind gpucheck, a pytest plugin for GPU kernels. 511 test configs, 8 real bugs found in Triton and PyTorch, and why the GPU community deserves better testing tools.

Read more