RAG Systems
GitHub Repositories
RAG_Techniques
24k starsComprehensive guide to advanced RAG techniques with implementations
RAGFlow
71k starsOpen-source RAG engine with deep document understanding
awesome-llm-apps
87k starsCollection of RAG apps using OpenAI, Anthropic, Gemini
LlamaIndex
40k starsData framework for LLM applications with RAG focus
LangChain
100k+ starsIndustry standard for building LLM applications
Chroma
18k starsAI-native open-source vector database
Tutorials & Courses
AI Agents
GitHub Repositories
GenAI_Agents
19k starsComprehensive tutorials for AI agent implementations
LangGraph
10k starsBuild stateful, multi-actor agent applications
CrewAI
42k starsMulti-agent orchestration framework
AutoGen
53k starsMicrosoft's multi-agent conversation framework
Phidata
25k starsBuild agentic systems with memory, knowledge, tools
PydanticAI
8k starsAgent framework with type-safe structured outputs
Tutorials & Courses
LLM Evaluation
GitHub Repositories
RAGAS
12k starsIndustry standard RAG evaluation framework
DeepEval
13k starsUnit testing framework for LLMs
Langfuse
20k starsOpen source LLM observability & evaluation
OpenAI Evals
15k starsOpenAI's official evaluation framework
LangSmith
FreemiumLangChain's debugging & monitoring platform
MLflow
19k starsLLM evaluation & experiment tracking (new LLM features)
Fine-tuning (LoRA/QLoRA)
GitHub Repositories
PEFT
18k starsHugging Face's parameter-efficient fine-tuning (LoRA, QLoRA)
Unsloth
32k stars2-5x faster fine-tuning with 70% less memory
Axolotl
9k starsStreamlined fine-tuning for various architectures
LLaMA-Factory
50k starsEasy fine-tuning with WebUI for 100+ LLMs
TRL
12k starsTransformer Reinforcement Learning (SFT, DPO, RLHF)
LLMs from Scratch
45k starsBuild LLM from scratch with book (2024 release)
Tutorials & Courses
LLMOps & Production
Serving & Inference
vLLM
45k starsHigh-throughput LLM serving with PagedAttention
SGLang
10k starsFast serving with structured generation support
Ollama
130k starsRun LLMs locally with simple API
OpenLLM
12k starsProduction LLM platform with BentoML
llama.cpp
80k starsLLM inference in C/C++ for edge devices
TGI
10k starsHugging Face's production text generation
Courses & Learning Paths
DeepLearning.AI (Free Short Courses - 2024-2025)
ChatGPT Prompt Engineering
FreeWith OpenAI - Best starting point
Building Systems with ChatGPT
FreeProduction LLM applications
Functions, Tools & Agents
FreeWith LangChain - Tool use & agents
Vector Databases & Embeddings
FreeWith Weaviate - Vector search fundamentals
LLMs with Semantic Search
FreeWith Cohere - RAG foundations
LLMOps
FreeWith Google Cloud - Production pipelines
Other Platforms
Hugging Face NLP Course
FreeTransformers, tokenizers, fine-tuning - updated 2024
fast.ai Practical Deep Learning
FreeTop-down practical approach to deep learning
Andrej Karpathy YouTube
FreeNeural networks, GPT from scratch - legendary content
Full Stack LLM Bootcamp
FreeProduction LLM applications - 2024 version
PyTorch & Transformers (ML Track)
Learning Path Recommendations
Pure AI Track (4 weeks)
- ChatGPT Prompt Engineering (DeepLearning.AI)
- LangChain: Chat With Your Data
- Building & Evaluating Advanced RAG
- AI Agents in LangGraph
- Build projects with LangChain + RAGFlow
ML-Oriented Track (6 weeks)
- PyTorch Tutorials + Hugging Face NLP Course
- LLMs from Scratch book + nanoGPT
- Finetuning LLMs (DeepLearning.AI)
- Hands-on with PEFT + Unsloth
- All Pure AI Track resources
- Build fine-tuned model project
Ready to Start Learning?
Choose your track and follow the roadmap