31 subscribers
انتقل إلى وضع عدم الاتصال باستخدام تطبيق Player FM !
المدونة الصوتية تستحق الاستماع
برعاية


Running Ray on Kubernetes with KubeRay
Manage episode 438351754 series 3332465
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand.
Check out our website at https://kubernetesbytes.com/
Cloud Native News:
- https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito
- https://orca.security/resources/blog/kubernetes-testing-environment/
- https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available
Show links:
- Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/
- KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html
- Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15)
- KubeRay repository: https://github.com/ray-project/kuberay
- Ray repository: https://github.com/ray-project/ray
- Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform
Timestamps:
- 00:02:40 Cloud Native News
- 00:07:20 Interview with Kai
- 00:49:15 Key takeaways
88 حلقات
Manage episode 438351754 series 3332465
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand.
Check out our website at https://kubernetesbytes.com/
Cloud Native News:
- https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito
- https://orca.security/resources/blog/kubernetes-testing-environment/
- https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available
Show links:
- Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/
- KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html
- Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15)
- KubeRay repository: https://github.com/ray-project/kuberay
- Ray repository: https://github.com/ray-project/ray
- Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform
Timestamps:
- 00:02:40 Cloud Native News
- 00:07:20 Interview with Kai
- 00:49:15 Key takeaways
88 حلقات
كل الحلقات
×
1 Database as a service with Percona Everest 1:02:44

1 Increasing AI adoption using Kubernetes 52:03

1 Monolith to Microservices using Kubernetes at Guidewire 1:06:28

1 Inference in Action: Scaling Al Smarter with Inferless 55:17

1 Dagger.io Deep Dive with Co-Founder Sam Alba 1:06:24

1 Running Ray on Kubernetes with KubeRay 53:06

1 Building scalable data platforms using Data on EKS 1:02:20

1 Deploy and fine-tune LLM models on Kubernetes using KAITO 44:17

1 The business case for cloud-native and Kubernetes 54:24

1 Building the AI Hyperscaler with Kubernetes 54:56

1 Shifting Minds: Exploring OpenShift's AI Landscape 1:05:07

1 Training Machine Learning (ML) models on Kubernetes 55:29

1 The evolution of service mesh technologies 1:08:00
مرحبًا بك في مشغل أف ام!
يقوم برنامج مشغل أف أم بمسح الويب للحصول على بودكاست عالية الجودة لتستمتع بها الآن. إنه أفضل تطبيق بودكاست ويعمل على أجهزة اندرويد والأيفون والويب. قم بالتسجيل لمزامنة الاشتراكات عبر الأجهزة.