microgpt-ts

A complete GPT built from scratch in TypeScript. Zero dependencies. Runs directly in your browser.

GPT-2-like architecture with tokenizer, autograd, multi-head attention, and Adam optimizer. Training & inference in ~400 lines of readable code. Train a model and generate text right here in your browser.

Inspired by Andrej Karpathy's microgpt