Book

Machine Learning Model Serving Patterns and Best Practices

Mastering the art of model serving is a crucial yet daunting task in the realm of machine learning. This comprehensive guide equips you with knowledge of various model serving techniques to seamlessly bring your machine learning models to fruition, while also highlighting the best practices in model deployment.

Offered byPackt Logo

Difficulty Level

Intermediate

Completion Time

11h12m

Language

English

About Book

Who Is This Book For?

This book is for machine learning engineers and data scientists who want to bring their models into production. Those who are familiar with machine learning and have experience of using machine learning techniques but are looking for options and strategies to bring their models to production will find great value in this book. Working knowledge of Python programming is a must to get started.

Book content

chapters 11h12m total length

Introducing Model Serving

Introducing Model Serving Patterns

Stateless Model Serving

Continuous Model Evaluation

Keyed Prediction

Batch Model Serving Pattern

Online Learning Model Serving

Two-Phase Model Pattern

Pipeline Pattern Model Serving

Ensemble Model Serving Pattern

Business Logic Pattern

Exploring Tensorflow Serving

Using Ray Serve

Using BentoML

Serving ML Models using a Fully Managed Cloud Solution

Related Resources

Access Ready-to-Use Books for Free!

Get instant access to a library of pre-built books—free trial, no credit card required. Start training your team in minutes!

No credit card required