Skip to content

Examples

Here are some examples of using the ICE Kubernetes Cluster (EKC) for various purposes.

vLLM Deploy an LLM using vLLM

This tutorial explains how to deploy an LLM for agentic or chatting purposes.

(Outdated) Deploying a chatbot

Demonstrates how to deploy a chatbot from Hugging Face and run GPU-accelerated inference as a load-balanced web service.