kserve-rest-proxy

Infra

Updated on August 1

KServe REST Proxy Overview

Secure your stack with a hardened KServe REST Proxy image freshly-built by Minimus. Minimus images always include the most up-to-date package version for all packages and dependencies.

KServe REST Proxy provides a RESTful API endpoint for KServe, translating standard HTTP/JSON requests into the gRPC protocol used by model servers.

Try It Out

Prerequisites

A running Kubernetes cluster (v1.21 or higher is recommended)
Helm v3.8 or higher for OCI support (Installation instructions)
kubectl installed and configured

Step 1: Start Cluster

If you have a cluster to work with, skip this step. Otherwise, start a Minikube cluster. Deployment instructions

Step 2: Download KServe Example Files

Download the example files from the Minimus examples repository:

wget -qO- https://github.com/minimusio/examples/archive/refs/heads/main.tar.gz | \
  tar -xz --strip-components=2 "examples-main/kserve"

Create a templates subdirectory:

mkdir templates

Step 3: Deploy KServe ModelMesh and KServe Proxy

Run the following command from your project directory to deploy KServe ModelMesh and KServe Proxy:

helm install kserve . \
  --namespace kserve \
  --create-namespace \
  --values values.yaml

Wait a few minutes for the assets to initialize before checking that all Pods are up and running:

kubectl get po -n kserve

Verify that the chart deployed the expected Minimus images:

kubectl -n kserve describe deploy kserve | grep Image:

Technical Considerations

The KServe REST Proxy image provided by Minimus is a slim, security-hardened alternative to the public image. The images are largely interchangeable, with a few differences as noted below.

KServe REST Proxy built by Minimus:

Runs as non-root by default as user 1000. The public image runs as user 2000.
Drill down on the version specification tab to see the default user, listening ports, entrypoint, volumes, environment variables, etc.

The Payoff

A hardened, minimal image that will remain more secure for the long run and accrue vulnerabilities at a slower rate.

See the risk reduction dashboard for a detailed CVE comparison over the past 30 days.
Review the compliance report to see the default hardening and security configurations for the image.

Terms & Info

Trademark

This catalog is published by Minimus. All product names, logos, and marks, other than those belonging to Minimus, shown are owned by their respective rights holders and appear here only to identify the open source software each image contains. Minimus claims no ownership of those marks and implies no affiliation with, endorsement by, certification by, or sponsorship by any rights holder.

Disclaimer

Images are provided "as-is" without warranty of any kind. "Hardened" refers to the security configuration applied at the time of build and does not constitute a guarantee of ongoing security or absence of vulnerabilities. The free tier is provided without support, SLA, or guaranteed patching timelines. Security updates may be applied to paid subscriptions before or instead of free tier images. By pulling or using any image you agree to our Terms of Use.