04 How Large Language Models (LLMs) Works? | All about LLMs | What are Tokens & Context Length?

Generative AI | LLM | GenAI | NN | Large Language Models ⏰ Scheduled to be Public from Members Only on 01st Jun 2026 16:00 HRS IST ⏰ ===== In this video, you will learn ===== What is Large Language Model? What is LLM? How LLMs work? Next Token Prediction in LLM, What are Tokens and Context Length? Importance on Tokens in LLM, Different Sampling Controls, LLM Personas and Prompts, Probability Distribution for LLMs ===== Chapters ===== 00:00 - Introduction 00:27 - What are Large Language Models or LLMs? 03:44 - How Large is Large in LLMs? 05:44 - Transformers 08:07 - What are Tokens and their Importance in LLM? 08:18 - What is Vocabulary in LLM? 14:27 - Probability Distribution for Tokens 19:01 - Sampling Controls - Temperature, Top-p 25:51 - Auto-Regressive Generation Loop 28:53 - How LLMs preserves meaning? 30:58 - How LLMs are Trained? 33:15 - What is Fine Tuning? 34:28 - LLM Personas/Roles and Prompts 36:55 - What is Context Length? 39:01 - Model Knowledge Cutoff and Hallucination 41:23 - Open and Closed LLM Models 42:36 - Reasoning Models 43:24 - Multimodal Models ===== Links ===== Google's "Attention is all You Need" Paper - https://arxiv.org/pdf/1706.03762 Groq Cloud - https://console.groq.com/home GPT Tokenizer - https://platform.openai.com/tokenizer ===== Other Playlists ===== Checkout all other playlists on Data Engineering 👇🏻 https://www.youtube.com/@easewithdata/playlists ===== GitHub Repo ===== https://github.com/subhamkharwal ===== Connect with ME ===== LinkedIn - https://www.linkedin.com/in/subhamkharwal Medium - https://subhamkharwal.medium.com ===== Hashtags ==== #genai #dataengineering #python #agenticai #aiagents #aiagent #nn #neuralnetworks