Enhance Cost Efficiency in Domain Adaptation with PruneMe
Offered By: MLOps World: Machine Learning in Production via YouTube
Course Description
Overview
Discover a layer pruning technique for Large Language Models (LLMs) that enhances cost efficiency in domain adaptation in this 17-minute conference talk from MLOps World: Machine Learning in Production. Explore the PruneMe repository, inspired by "The Unreasonable Ineffectiveness of the Deeper Layers," and learn how removing redundant layers facilitates continual pre-training on streamlined models. Understand the process of merging these models into a top-performing general model using advanced techniques like Evolve Merging. Gain insights into this cost-effective approach to model optimization and adaptation, presented by Shamane Siri, Ph.D., Head of Applied NLP Research at Arcee.ai.
Syllabus
Enhance Cost Efficiency in Domain Adaptation with PruneMe
Taught by
MLOps World: Machine Learning in Production
Related Courses
Machine Learning Operations (MLOps): Getting StartedGoogle Cloud via Coursera Проектирование и реализация систем машинного обучения
Higher School of Economics via Coursera Demystifying Machine Learning Operations (MLOps)
Pluralsight Machine Learning Engineer with Microsoft Azure
Microsoft via Udacity Machine Learning Engineering for Production (MLOps)
DeepLearning.AI via Coursera