Loading…
← Back to schedule
⚡ Lightning Talk: Transform Your Kubernetes Cluster Into a GenAI Platform: Get Ready-to-Use LLM APIs Today! - Kenji Kaneda, CloudNatix Inc.
Tuesday November 12, 2024 5:00pm - 5:10pm MST
Salt Palace | Level 1 | Grand Ballroom A
Are you eager to fine-tune LLMs and run inference directly within your Kubernetes clusters? Do you want an API compatible with OpenAI to leverage the extensive GenAI ecosystem? If so, LLMariner (https://llmariner.ai) is what you need. It instantly builds a software stack that provides an OpenAI-compatible API for inference, fine-tuning, and model management. In this talk, we'll provide an overview of the LLMariner and showcase its capabilities through practical use cases. Join us to learn how you can leverage LLMariner to enhance Kubernetes for your Generative AI workflows.
Speakers
avatar for Kenji Kaneda

Kenji Kaneda

Chief Architect, CloudNatix Inc.
Kenji is a chief architect at CloudNatix and has been working on large-scale distributed systems - especially cluster management systems - for over ten years. Most recently, he was a Principal Engineer at Nvidia, responsible for developing their deep learning training platform and... Read More →
transform your kubernetes cluster into genai platform pdf
Tuesday November 12, 2024 5:00pm - 5:10pm MST
Salt Palace | Level 1 | Grand Ballroom A
  Cloud Native + Kubernetes AI Day, Best practices for ML Infrastructure
Feedback form is now closed.

Attendees (101)


Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link