LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

7d Not tracked yet — first tracked 2026-08-26

30d Not tracked yet — first tracked 2026-08-26

90d Not tracked yet — first tracked 2026-08-26

103,801 → 103,902 stars since Aug 26

★ 103,814 stars on GitHub Visit site ↗

ai artificial-intelligence attention-mechanism deep-learning finetuning from-scratch generative-ai gpt instruction-tuning language-model large-language-models llm machine-learning natural-language-processing pretraining python pytorch tokenizer transformers