Shakti's Blog
This is my corner of the internet where I nerd out about the stuff I love — systems, infrastructure, and AI. If it scales, breaks, or learns, I’m probably writing about it.
Posts
-
Deconstruction Series #1: Rebuilding GPT-2 in Pure C
Welcome to the GPT-2 Deconstruction Series — a deep dive into how GPT-2 really works, built from the ground up in pure C. No Python. No PyTorch. No magic. Just raw logic, memory management, and the beauty (and pain) of doing everything yourself. Whether you’re here to learn how transformers tick, or just enjoy bending C to your will, this is your guide to building GPT-2 step by step — from tokenization to text generation. Check Out the GPT-2 C Implementation: gpt2.c Read more
subscribe via RSS