A PERSONAL NOTEBOOK

Hi, I’m Tarun.

I’m an engineer at Judgment Labs, working on infrastructure and agents. This is my notebook on ML systems, software, and what I’m learning.

More about me

Latest writing

RSS

1 post

Inside a modern LLM inference runtime

How vLLM turns requests into GPU work through continuous batching, KV-cache paging, and token scheduling.