Deploying machine learning models on Kubernetes
YouTube Viewers YouTube Viewers
7.02K subscribers
12,809 views
0

 Published On Mar 19, 2023

In this video, we will go through a simple end to end example how to deploy a ML model on Kubernetes. We will use an pretrained Transformer model on the task of masked language modelling (fill-mask) and turn it into a REST API. Then we will containerize our service and finally deploy it on a Kubernetes cluster.

Code from the video:
https://github.com/jankrepl/mildlyove...

00:00 Intro
00:22 3 step procedure diagram
01:42 Existing framework overview
02:09 Creating an API
09:25 Containerization
13:53 Containerization - custom platform
15:47 Preparing a minikube K8s cluster
17:43 K8s: Deployment and service
21:31 K8s: 2 cool features - self-healing and load balancing
26:00 Outro

If you have any video suggestions or you just wanna chat feel free to join the discord server:   / discord  

Twitter:   / moverfitted  

Credits logo animation
Title: Conjungation · Author: Uncle Milk · Source:   / unclemilk   · License: https://creativecommons.org/licenses/... · Download (9MB): https://auboutdufil.com/?id=600

show more

Share/Embed