5-Day LLM Foundations Roadmap 2024

If you're feeling overwhelmed by the scattered knowledge about LLMs, this roadmap and curated resources from top sources are here to guide you. Dedicate 2-3 hours daily to understand the resources thoroughly, and by the fifth day, you'll be ready to develop your own LLM application! This roadmap is designed for individuals with basic machine learning knowledge. The optional content can be explored when time permits. Enjoy the learning journey! Once you've established your foundation, utilize this repository to delve into research papers, explore additional courses, and continue enhancing your skills.

Applied_LLMs_(28).png

Day 1: LLM Basics and Foundations

Watch these videos (1 hour):

  1. LLM Foundations by FullStack (link)

Read these resources (1 hour):

  1. Applied LLMs Mastery course week 1 content (link)
  2. Applications of LLMs article by CellStrat (link)
  3. What are LLMs article by Amazon (link)
  4. (Optional) A survey of LLMs paper(link)

Day 2: Prompting for LLMs

Watch these videos (1 hour):

  1. Prompt engineering course by Deeplearning.AI (link)

Read these resources (1 hour):

  1. Applied LLMs Mastery week course 2 content (link)
  2. Introduction to prompt engineering guide (link)
  3. Advanced prompt engineering techniques guide (link)

Day 3: Retrieval Augmented Generation (RAG)

Watch these videos (30 mins):

  1. What is RAG by Deeplearning.AI (link)
  2. Building production ready RAG applications course by LlamaIndex (Link)
  3. (Optional) RAG with pinecone and Langchain video (link)

Read these resources (1 hour):

  1. Applied LLMs Mastery course week 4 content (link)
  2. RAG blog post by Amazon (link)
  3. Blog on advanced RAG techniques by Akash (link)

Day 4: LLM Fine-Tuning

Watch these videos (1.5 hours):

  1. LLM Fine-Tuning Deeplearning.AI (link)
  2. Advanced fine-tuning techniques on YouTube by Shaw (link)

Read these resources (1 hour):

  1. Applied LLMs Mastery course week 3 content (link)
  2. Guide for fine-tuning LLMs by Labellerr (link)
  3. PEFT methods by HuggingFace (link)

Day 5: LLM Applications and Tooling

Watch these videos (1 hour):

  1. Build your own LLM application using LangChain course by Deeplearning.AI (link)

Read these resources (1 hour):

  1. Applied LLMs Mastery course week 5 content (link)
  2. Tools for LLM Applications blog by a16z (link)
Interactive Graph
Table Of Contents
5-Day LLM Foundations Roadmap 2024
Day 1: LLM Basics and Foundations
Day 2: Prompting for LLMs
Day 3: Retrieval Augmented Generation (RAG)
Day 4: LLM Fine-Tuning
Day 5: LLM Applications and Tooling