Videos de Java
Videos etiquetados con "Java"
Java 2 videos
Spring AI 2.0: Custom Advisors for Tool & Token Logging
Ever wondered which tools your LLM is actually using and how many tokens each call is consuming? Spring AI Advisors give you AOP-like superpowers for your AI interactions, letting you intercept, log, and monitor every call to your language model. In this video, we explore Spring AI's Advisor API by building two custom advisors from scratch. The first is an AvailableToolsLoggingAdvisor that shows which tools are visible to the model before a call and which ones were actually invoked after. The second is a TokenCounterAdvisor that tracks prompt tokens, completion tokens, and total tokens with running totals across multiple calls. Along the way, you'll learn how advisors work as before/after interceptors for LLM calls, how to use the ChatResponse metadata, and how to wire tools into your Spring AI chat client. - Understand what Spring AI Advisors are and how they act as AOP for LLM calls - Build an AvailableToolsLoggingAdvisor to log which tools are loaded and which are invoked - Build a TokenCounterAdvisor to track prompt, completion, and total token usage per call - Learn how to use ChatResponse metadata for usage statistics - Wire up custom tools (like a DateTime tool) and see them in action with advisors 0:00 - Intro - Why I needed custom advisors 1:10 - What are Spring AI Advisors? 2:30 - Spring AI Reference Docs & Built-in Advisors 3:30 - Project setup on start.spring.io 4:30 - Configuring API key and model 5:15 - Creating the ChatController and ChatResponse 6:45 - Understanding token usage from ChatResponse 8:00 - Adding a DateTime tool for LLM calls 10:00 - Building the AvailableToolsLoggingAdvisor (before) 13:30 - Adding the after method to log invoked tools 16:30 - Testing the AvailableToolsLoggingAdvisor 17:45 - Building the TokenCounterAdvisor 20:30 - Testing the TokenCounterAdvisor 21:30 - Wrap up & what's next (Tool Searching) 🔗Resources & Links mentioned in this video: Spring AI Reference Documentation - Advisors: https://docs.spring.io/spring-ai/reference/api/advisors.html Spring Initializr: https://start.spring.io Dan Vega's Spring AI Workshop (GitHub): https://github.com/danvega/spring-ai-workshop 👋🏻Connect with me: Website: https://www.danvega.dev Twitter: https://twitter.com/therealdanvega Github: https://github.com/danvega LinkedIn: https://www.linkedin.com/in/danvega Newsletter: https://www.danvega.dev/newsletter SUBSCRIBE TO MY CHANNEL: http://bit.ly/2re4GH0 ❤️
The AI Factory: Engineering Modern LLM Inference Pipelines | Uplatz
Modern AI systems are no longer simple models running isolated predictions—they operate like massive digital factories processing billions of requests, orchestrating GPUs, managing memory, and delivering intelligent responses at global scale. In this video, we explore “The AI Factory” and break down how modern LLM inference pipelines are engineered for performance, scalability, and efficiency. This video is by Uplatz. You’ll learn how large language model inference works behind the scenes, from token generation and request routing to distributed GPU execution and response optimization. We explain why inference engineering has become one of the most critical challenges in the generative AI era. The video dives into core components of modern inference pipelines including model serving, batching strategies, KV cache management, GPU scheduling, vector databases, retrieval-augmented generation (RAG), and low-latency orchestration systems. You’ll understand how organizations optimize infrastructure to reduce inference costs while maintaining performance and responsiveness. We also explore technologies and frameworks used in production AI systems such as Kubernetes, Ray, and vLLM for scalable AI deployment and inference acceleration. Additionally, we discuss concepts like model quantization, mixture-of-experts (MoE) architectures, inference parallelism, autoscaling, observability, and AI infrastructure optimization. Learn how companies engineer AI platforms capable of serving millions of users across enterprise applications, copilots, AI agents, and multimodal systems. Whether you're an AI engineer, platform architect, DevOps professional, cloud engineer, researcher, or technology enthusiast, this video provides a practical and structured understanding of how modern LLM inference factories operate at scale. For full course browse https://uplatz.com/online-courses #LLM #GenerativeAI #AIInfrastructure #MLOps #LLMOps #ArtificialIntelligence #vLLM #GPUComputing #AIEngineering #Uplatz ---------------------------------------------- 🌐 Welcome to Uplatz – Your Gateway to Career Transformation! To access full courses or training bundles: 🌐 https://uplatz.com 📧 support@uplatz.com 🎓 About Uplatz Uplatz is a global leader in online IT and professional training, offering comprehensive courses in AI, machine learning, data science, cloud computing, cybersecurity, and enterprise technologies such as SAP, Oracle, Salesforce, and ServiceNow. With expert-led programs and real-world learning paths, Uplatz empowers learners and organizations across 190+ countries to build future-ready skills and thrive in the digital era. 📘 Explore Uplatz Course Portfolio Learn the most in-demand and emerging technologies with Uplatz: ✅ AI & Machine Learning – Agentic AI, LLMs, LangChain, Deep Learning, MLOps, LLMOps ✅ Cloud & DevOps – AWS, Azure, GCP, Docker, Kubernetes, Terraform, CI/CD ✅ Data & Analytics – Data Science, Data Engineering, Power BI, Tableau, Big Data (Spark, Kafka) ✅ Programming & Frameworks – Python, FastAPI, Django, Java, JavaScript, SQL ✅ Cybersecurity & Blockchain – Ethical Hacking, Cloud Security, Zero Trust, Blockchain & Web3 ✅ IoT & Embedded Systems – IoT Platforms, Edge Computing, Embedded C, Microcontrollers ✅ ERP & CRM – SAP (all modules), Salesforce, Oracle ERP, Microsoft Dynamics ✅ Web & App Development – Full-Stack Development, React, Angular, Node.js, Flutter 🎓 Master cutting-edge skills. Build your tech career with Uplatz. 🌐 Learn more: https://uplatz.com 🎯 Why Choose Uplatz ✔️ Job-focused, project-based learning ✔️ Globally recognized certifications ✔️ Lifetime access & affordable pricing ✔️ Career guidance and mentorship 🔔 Subscribe for weekly tech tutorials, demos, and success stories. 📲 Follow us on LinkedIn, Instagram, Twitter, and Facebook. #Uplatz #Tech #Technology #MachineLearning #CloudComputing #Learning