LLMs-from-scratch

User

by rasbt

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

View on GitHub

#ai #artificial-intelligence #chatbot #chatgpt #deep-learning #from-scratch #generative-ai #gpt+8 more

85.9k

Stars

13.0k

Forks

85.9k

Watchers

Issues

Repository Details

Created

Jul 23, 2023

Last Updated

Feb 25, 2026

Primary Language

Jupyter Notebook

License

Repository Size

16.1k KB

Quick Actions

Open in GitHub

Project Overview

About this repository

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Technologies & Topics

ai artificial-intelligence chatbot chatgpt deep-learning from-scratch generative-ai gpt language-model large-language-models llm machine-learning neural-networks python pytorch transformers

Default Branch

main

README

LLMs-from-scratch

User

by rasbt

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

View on GitHub

#ai #artificial-intelligence #chatbot #chatgpt #deep-learning #from-scratch #generative-ai #gpt+8 more

85.9k

Stars

13.0k

Forks

85.9k

Watchers

Issues

Repository Details

Created

Jul 23, 2023

Last Updated

Feb 25, 2026

Primary Language

Jupyter Notebook

License

Repository Size

16.1k KB

Quick Actions

Open in GitHub

Project Overview

About this repository

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Technologies & Topics

ai artificial-intelligence chatbot chatgpt deep-learning from-scratch generative-ai gpt language-model large-language-models llm machine-learning neural-networks python pytorch transformers

Default Branch

main

README

Command Palette

LLMs-from-scratch

About this repository

Technologies & Topics

Default Branch

LLMs-from-scratch

About this repository

Technologies & Topics

Default Branch