LLM Tool Use - GPT4o-mini, Groq, and Llama.cpp
Offered By: Trelis Research via YouTube
Course Description
Overview
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore advanced techniques for leveraging Language Model (LLM) tools in this comprehensive video tutorial. Dive into function calling methodologies for cheap, fast, local, and enterprise applications. Learn about tool use flow charts, function preparation tips, and code walk-throughs for effective tool integration. Discover how to implement prompt preparation and recursive tool use strategies. Evaluate the performance of various models including GPT4o-mini, Phi-3 Mini, and Llama 3 in zero-shot and fine-tuned scenarios. Gain insights into parallel function calling, low latency tool use with Groq, and local inference on Mac using llama.cpp. Access valuable resources and receive final tool use tips to enhance your LLM tool utilization skills.
Syllabus
Function Calling - Cheap, Fast, Local and Enterprise
Video Overview
Tool Use Flow Chart
Function preparation tips
Resources trelis.com/ADVANCED-inference
Code walk-through for function / tool preparation
Prompt preparation and Recursive tool use
GPT4o-mini tool use performance
Zero shot prompting and Runpod Phi-3 endpoint setup
Phi-3 Mini Zero Shot Performance
Parallel function calling with Phi-3
Low latency tool use with Groq - Zero shot
Groq Llama 3 8B Zero Shot Tool Use Performance
Groq Llama 3 8B Fine-tune Performance
Groq Llama 3 70B Fine-tune Performance
Local Phi-3 Inference on a Mac with llama.cpp
Final Tool Use Tips
Resources
Taught by
Trelis Research
Related Courses
Code Understanding with Langchain, CodeLLama, Llama.cpp and OpenAIThe Machine Learning Engineer via YouTube Fine-Tuning a Local Mistral 7B Model - Step-by-Step Guide
All About AI via YouTube How to Quantize a Large Language Model with GGUF or AWQ
Trelis Research via YouTube Autogen and Local LLMs Create Realistic Stable Diffusion Model Autonomously
kasukanra via YouTube Running LLMs in the Cloud - Approaches and Best Practices
CNCF [Cloud Native Computing Foundation] via YouTube