Videos de encoder decoder
Videos etiquetados con "encoder decoder"
encoder decoder 2 videos
✅ How Transformers Work - Attention Explained Step by Step | Chapter 06
How do transformers actually work inside an LLM? This video breaks down the full transformer architecture - attention, encoder vs decoder, and next-token prediction - in plain English, no scary math required. Transformers are the secret sauce behind GPT, Claude, and every frontier model. By the end of this video you'll be able to look at the "Attention Is All You Need" diagram and understand exactly what every block does and why it's there. ===== In this video, you will learn ===== • The one big idea behind attention (the "I left my phone on the bank" example) • Encoder vs decoder - and why GPT and Claude use only the decoder • How multi-head attention splits 768 dimensions into 12 heads • Query, Key and Value explained with a networking + Google search analogy • What the feed forward layer, residual connections and layer norm really do • How the output head turns a vector into the next token (logits + softmax) • What causal masking, the generation loop, KV cache and TTFT mean This is Part 06 of the GenAI Fundamentals series - for data engineers, developers, and anyone learning how AI language models actually work. Watch the tokenization + vector embeddings video first if you haven't already. ===== Chapters ===== 00:00 What is a Transformer? (Attention Is All You Need) 02:07 Recap - Tokens, Embeddings and Dimensions 03:06 Why Transformers are Math Machines (Matrix Multiplication) 04:37 The One Big Idea Behind Attention 07:30 Encoder vs Decoder - What's the Difference? 10:57 Why GPT and Claude Use Only the Decoder 12:40 The 3 Families of Models (BERT, GPT, Transformer) 13:25 The Big Picture - Embedding, Blocks, Output Head 16:12 Inside a Single Transformer Block 18:53 What is Layer Normalization? 20:11 How Attention Works? 23:21 What is Multi-Head Attention? 26:02 Query, Key and Value Explained 28:44 The Attention Math - Scores and Softmax 34:30 What is the Feed Forward Layer? 38:36 The Output Head - From Vector to Next Token 39:04 What is Causal Masking? 43:36 The Generation Loop 44:13 What is KV Cache and TTFT? 45:55 Reading the "Attention Is All You Need" Diagram 48:00 Recap and What's Next (Prompt Engineering) Tokenization and Word Embedding Video - https://youtu.be/JyaAmvsel9w ===== Other Playlists ===== Checkout all other playlists on Data Engineering 👇🏻 https://www.youtube.com/@easewithdata/playlists ===== GitHub Repo ===== https://github.com/subhamkharwal https://github.com/subhamkharwal/genai-for-data-engineers ===== Connect with ME ===== LinkedIn - https://www.linkedin.com/in/subhamkharwal Medium - https://subhamkharwal.medium.com ===== References ===== Jay Alammar - https://jalammar.github.io/illustrated-transformer/ 3Blue1Brown - https://www.3blue1brown.com/lessons/attention/ ===== Hashtags ===== #Transformers #AttentionIsAllYouNeed #LLM #GenerativeAI #genai #dataengineering #neuralnetworks #machinelearning
Autoencoders - Explained
An autoencoder is a neural network that learns to compress its own input and rebuild it. We start with the impossible-sounding task — squeeze a 49-pixel image down to two numbers and expand it back — then build the hourglass architecture, split it into encoder and decoder, and derive the reconstruction loss that trains the whole thing without a single label. By the end you'll see why the bottleneck is the real trick: forcing the network to carry meaning through a narrow waist is what organises the latent space and turns one idea into denoising, anomaly detection, and generation. *Related Videos* ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Variational Autoencoder - Explained: https://youtu.be/geH5HnRapRs Generative Adversarial Networks (GANs) - Explained: https://youtu.be/G-fXV-o9QV8 Convolutional Neural Networks (CNNs) - Explained: https://youtu.be/YGILT182T6w Recurrent Neural Networks (RNNs) - Explained: https://youtu.be/8G1fImBCMcQ Backpropagation is Just the Chain Rule: https://youtu.be/VCGlYxGJZ04 Activation Functions in Neural Networks - Explained: https://youtu.be/slp222E_0d4 UMAP - Explained: https://youtu.be/kwILqPNZyeo Normalization vs Standardization - Explained: https://youtu.be/87C5hkTY8RI *Contents* ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 00:00 - The Impossible Shortcut 00:22 - The Bottleneck 00:53 - Encoder and Decoder 01:21 - Reconstruction Loss 01:48 - The Latent Space 02:08 - Why This Matters *Follow Me* ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 🐦 X: @datamlistic https://x.com/datamlistic 📸 Instagram: @datamlistic https://www.instagram.com/datamlistic 📱 TikTok: @datamlistic https://www.tiktok.com/@datamlistic 👔 Linkedin: https://www.linkedin.com/company/datamlistic *Channel Support* ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ The best way to support the channel is to share the content. ;) If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary) ► Patreon: https://www.patreon.com/datamlistic ► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq ► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281 ► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5 ► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a #autoencoders #deeplearning #machinelearning