Videos de ease with data
Videos etiquetados con "ease with data"
ease with data 2 videos
✅ How Transformers Work - Attention Explained Step by Step | Chapter 06
How do transformers actually work inside an LLM? This video breaks down the full transformer architecture - attention, encoder vs decoder, and next-token prediction - in plain English, no scary math required. Transformers are the secret sauce behind GPT, Claude, and every frontier model. By the end of this video you'll be able to look at the "Attention Is All You Need" diagram and understand exactly what every block does and why it's there. ===== In this video, you will learn ===== • The one big idea behind attention (the "I left my phone on the bank" example) • Encoder vs decoder - and why GPT and Claude use only the decoder • How multi-head attention splits 768 dimensions into 12 heads • Query, Key and Value explained with a networking + Google search analogy • What the feed forward layer, residual connections and layer norm really do • How the output head turns a vector into the next token (logits + softmax) • What causal masking, the generation loop, KV cache and TTFT mean This is Part 06 of the GenAI Fundamentals series - for data engineers, developers, and anyone learning how AI language models actually work. Watch the tokenization + vector embeddings video first if you haven't already. ===== Chapters ===== 00:00 What is a Transformer? (Attention Is All You Need) 02:07 Recap - Tokens, Embeddings and Dimensions 03:06 Why Transformers are Math Machines (Matrix Multiplication) 04:37 The One Big Idea Behind Attention 07:30 Encoder vs Decoder - What's the Difference? 10:57 Why GPT and Claude Use Only the Decoder 12:40 The 3 Families of Models (BERT, GPT, Transformer) 13:25 The Big Picture - Embedding, Blocks, Output Head 16:12 Inside a Single Transformer Block 18:53 What is Layer Normalization? 20:11 How Attention Works? 23:21 What is Multi-Head Attention? 26:02 Query, Key and Value Explained 28:44 The Attention Math - Scores and Softmax 34:30 What is the Feed Forward Layer? 38:36 The Output Head - From Vector to Next Token 39:04 What is Causal Masking? 43:36 The Generation Loop 44:13 What is KV Cache and TTFT? 45:55 Reading the "Attention Is All You Need" Diagram 48:00 Recap and What's Next (Prompt Engineering) Tokenization and Word Embedding Video - https://youtu.be/JyaAmvsel9w ===== Other Playlists ===== Checkout all other playlists on Data Engineering 👇🏻 https://www.youtube.com/@easewithdata/playlists ===== GitHub Repo ===== https://github.com/subhamkharwal https://github.com/subhamkharwal/genai-for-data-engineers ===== Connect with ME ===== LinkedIn - https://www.linkedin.com/in/subhamkharwal Medium - https://subhamkharwal.medium.com ===== References ===== Jay Alammar - https://jalammar.github.io/illustrated-transformer/ 3Blue1Brown - https://www.3blue1brown.com/lessons/attention/ ===== Hashtags ===== #Transformers #AttentionIsAllYouNeed #LLM #GenerativeAI #genai #dataengineering #neuralnetworks #machinelearning
How LLMs Understand your Prompts: Tokenization & Embeddings | Chapter 05
What are vector embeddings and tokenization, and how do they let an LLM understand meaning? This video explains tokenization, embeddings, vector dimensions, cosine similarity and positional embeddings - with a hands-on coding demo. ===== In this video, you will learn ===== • What tokenization is and the main types of tokenizers (incl. Byte Pair Encoding) • What vector embeddings are, and what vectors & dimensions actually mean • How an LLM captures meaning using embeddings • How cosine similarity measures how "close" two pieces of text are • Positional embeddings - how models know word order • A hands-on Python demo: tokenizer + embeddings in code This is Part 5 of the GenAI Fundamentals series - for data engineers, developers, and anyone learning how AI language models actually work. ===== Chapters ===== 00:00 - Introduction 00:32 - What is Tokenization and Vector Embeddings? 03:41 - What are Vectors and Dimensions? 06:37 - Why Vectors matter for LLMs? 07:59 - How meaning is captured using Embedding? 12:30 - What is Cosine Similarity? 14:08 - Types of Tokenizers 17:50 - (Hands on) Coding for Tokenizer and Embeddings 26:48 - What are Positional Embeddings? ===== Links ===== Google's "Attention is all You Need" Paper - https://arxiv.org/pdf/1706.03762 Groq Cloud - https://console.groq.com/home GPT Tokenizer - https://platform.openai.com/tokenizer Google Collab - https://colab.research.google.com/ Byte Pair Encoding (BPE) - https://www.geeksforgeeks.org/nlp/byte-pair-encoding-bpe-in-nlp/ Github Code - https://github.com/subhamkharwal/genai-for-data-engineers/blob/master/codes/genai_chap05.ipynb ===== Other Playlists ===== Checkout all other playlists on Data Engineering 👇🏻 https://www.youtube.com/@easewithdata/playlists ===== GitHub Repo ===== https://github.com/subhamkharwal https://github.com/subhamkharwal/genai-for-data-engineers ===== Connect with ME ===== LinkedIn - https://www.linkedin.com/in/subhamkharwal Medium - https://subhamkharwal.medium.com ===== Hashtags ===== #VectorEmbeddings #Tokenization #LLM #GenerativeAI #genai #dataengineering #python #neuralnetworks #machinelearning