sgrvinod/Deep-Tutorials-for-PyTorch

In-depth tutorials for implementing deep learning models on your own with PyTorch.

pytorchpytorch-tutorialpytorch-tutorialslearning-pytorchdeep-learning-tutorialneural-network-tutorials
Star 增长趋势
Star
1.6k
Forks
224
周增长
+1
Issues
1
5001k1.5k
2023年1月2024年3月2025年6月2026年9月
README

Deep Tutorials for PyTorch

This is a series of in-depth tutorials I'm writing for implementing cool deep learning models on your own with the amazing PyTorch library.

Basic knowledge of PyTorch and neural networks is assumed.

If you're new to PyTorch, first read Deep Learning with PyTorch: A 60 Minute Blitz and Learning PyTorch with Examples.


24 Apr 2023: I've just completed the Super-Resolution and Transformers tutorials.

09 Dec 2023: Interested in chess or transformers? Check out Chess Transformers.


In each tutorial, we will focus on a specific application or area of interest by implementing a model from a research paper.

Application Paper Tutorial Also Learn About Status
Image Captioning Show, Attend, and Tell a PyTorch Tutorial to Image Captioning • encoder-decoder architecture

• attention

• transfer learning

• beam search
🟢
complete
Sequence Labeling Empower Sequence Labeling with Task-Aware Neural Language Model a PyTorch Tutorial to Sequence Labeling • language models

• character RNNs

• multi-task learning

• conditional random fields

• Viterbi decoding

• highway networks
🟢
complete
Object Detection SSD: Single Shot MultiBox Detector a PyTorch Tutorial to Object Detection • single-shot detection

• multiscale feature maps

• priors

• multibox

• hard negative mining

• non-maximum suppression
🟢
complete
Text Classification Hierarchical Attention Networks for Document Classification a PyTorch Tutorial to Text Classification • hierarchical attention 🟡
code complete
Super-Resolution Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network a PyTorch Tutorial to Super-Resolution GANs — this is also a GAN tutorial

• residual connections

• sub-pixel convolution

• perceptual loss
🟢
complete
Machine Translation Attention Is All You Need a PyTorch Tutorial to Transformers transformers

• multi-head attention

• positional embeddings

• encoder-decoder architecture

• byte pair encoding

• beam search
🟢
complete
Semantic Segmentation SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers a PyTorch Tutorial to Semantic Segmentation N/A 🔴
planned
相关仓库
huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

PythonPyPIApache License 2.0nlpnatural-language-processing
huggingface.co/transformers
165k34.5k
AUTOMATIC1111/stable-diffusion-webui

Stable Diffusion web UI

PythonPyPIGNU Affero General Public License v3.0deep-learningdiffusion
164.9k30.5k
Comfy-Org/ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

PythonPyPIGNU General Public License v3.0stable-diffusionpytorch
comfy.org
132.1k15.6k
rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Jupyter NotebookOthergptlarge-language-models
amzn.to/4fqvn0D
104.6k16k
vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

PythonPyPIApache License 2.0gptllm
vllm.ai
91.3k21.9k
labmlai/annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

PythonPyPIMIT Licensedeep-learningdeep-learning-tutorial
nn.labml.ai
67.4k6.8k
keras-team/keras

Deep Learning for humans

PythonPyPIApache License 2.0deep-learningtensorflow
keras.io
64.3k19.8k
ultralytics/ultralytics

Ultralytics YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose estimation, object tracking

PythonPyPIGNU Affero General Public License v3.0ultralyticsyolov8
platform.ultralytics.com
61.4k11.7k
CorentinJ/Real-Time-Voice-Cloning

Clone a voice in 5 seconds to generate arbitrary speech in real-time

PythonPyPIOtherdeep-learningpytorch
60.1k9.4k
ultralytics/yolov5

Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.

PythonPyPIGNU Affero General Public License v3.0yolov5object-detection
docs.ultralytics.com/yolov5/
58k17.5k
roboflow/supervision

We write your reusable computer vision tools. 💜

PythonPyPIMIT Licensecomputer-visionimage-processing
supervision.roboflow.com
49.9k4.8k
GokuMohandas/Made-With-ML

Learn how to develop, deploy and iterate on production-grade ML applications.

Jupyter NotebookMIT Licensemachine-learningdeep-learning
madewithml.com
49.4k7.8k