Generative AI in Production
Contact IT Dojo for current pricing, available dates, and a custom quote tailored to your team or organization.
Course Duration
1 Day
Audience
Employees of federal, state and local governments; and businesses working with the government.
Prerequisites
Familiarity with software deployment or MLOps concepts recommended.
Course Description
Traditional MLOps is a set of practices for productionizing conventional ML systems for enterprise use. Generative AI raises new challenges in managing and productionizing applications at scale: unpredictable output, prompt and model versioning, cost management, and evaluation approaches that differ from classic ML metrics. This one-day course covers the practices and tooling needed to take a generative AI application from prototype to reliable production system.
Learning Objectives
- Explain how productionizing generative AI differs from traditional MLOps
- Apply versioning and change management practices to prompts and models
- Evaluate and monitor generative AI application output in production
- Apply cost, scaling, and reliability strategies to a generative AI application
Course Outline
1. From MLOps to GenAIOps
- How productionizing generative AI differs from traditional MLOps
- New failure modes: hallucination, drift, and prompt sensitivity
- Key components of a GenAIOps practice
2. Versioning and Change Management
- Versioning prompts, models, and application logic together
- Managing model and provider changes over time
- Testing changes before they reach production
3. Evaluation and Monitoring
- Evaluation approaches for generative AI output
- Monitoring quality, cost, and latency in production
- Detecting drift and degraded output over time
4. Cost, Scale, and Reliability
- Cost management strategies for LLM-powered applications
- Scaling generative AI applications reliably
- Building fallback and error-handling strategies
5. Wrap-Up
- Building a production readiness checklist for a generative AI application
- Final questions and key takeaways
Frequently Asked Questions
What does this course cover?
This course covers the practices and tooling needed to take a generative AI application to production: versioning, evaluation, monitoring, cost, and reliability.
How long is this course?
Generative AI in Production is a one-day course, available as live remote online instruction or on-site at your facility.
Who should attend?
ML engineers, platform engineers, and technical leads responsible for taking generative AI applications to production.
Does IT Dojo offer this training on-site at government or DoD facilities?
Yes. IT Dojo delivers this course on-site at government agencies, DoD commands, and contractor facilities, in addition to live online delivery.
How do I register for this course?
IT Dojo training is employer sponsored. Contact IT Dojo via the Request Training form or call 757-216-3656 to schedule this course for your team.