A small from-scratch language model (RoPE, QK-Norm, RMSNorm, SwiGLU) trained on TinyTextbooks. Enter a prompt and generate a continuation.