Deploying Your Own Language Models - A Use Case Demo with Open Source Tools

Explore the process of building and deploying domain-specific language models using open source tools in this informative conference talk. Learn how to adapt pre-trained models and leverage libraries such as LangChain, Hugging Face, Kubernetes, Open Data Hub, and ModelMesh for a question-answering application. Gain insights into model serving, cost and performance optimization techniques, prompt engineering, fine-tuning, and ethical and legal considerations. Discover how to effectively utilize open source resources to create tailored language models that meet specific requirements while optimizing resource allocation.

Deploying Your Own Language Models: A Use Case Demo with Open Source... - Shrey Anand & Surya Pathak