lyricsLM a transformer, from scratch, in your browser notebook & article ↗

Type a line.
Watch it become verse.

This model read Tagore, Sarojini Naidu, Dickinson and Poe — nothing else, nothing under copyright. It has 2.7 million parameters, a fraction of a fraction of a frontier model. Every character it writes is computed right now, on your machine, from the checkpoint you pick below. Nothing is sent anywhere.

Choose a moment in training
Give me a line of poetry to continue — try “and miles to go before I sleep”, or write your own.
Loading…

What's actually happening

01

Weights load once

Your browser fetches the checkpoint's numbers as a flat binary file — about 11MB. After that, everything runs locally.

02

No server, ever

The forward pass — embeddings, attention, softmax, sampling — is plain JavaScript running on your device. There's nothing to log, nothing to send.

03

Same math, three moments

Baby, halfway and trained are the identical architecture with different numbers — saved at step 0, step 1,500, and step 5,000 of the same training run.