Research-grade PyTorch implementation of a small GPT-style model, rebuilt from scratch to internalize attention, positional encoding, KV-caching, and training dynamics. Built for intuition, not benchmarks.
nanoGPT from scratch
Educational reimplementation of autoregressive language models to master the fundamentals of modern Transformer architectures.
PyTorchTransformer TrainingLanguage Modeling