kserve-modelmesh
KServe ModelMesh Overview
Secure your stack with a hardened KServe ModelMesh image freshly-built by Minimus. Minimus images always include the most up-to-date package version for all packages and dependencies.
KServe ModelMesh is a multi-model serving system for KServe that can efficiently deploy and manage thousands of machine learning models by loading them into memory on demand.
Try It Out
Prerequisites
- A running Kubernetes cluster (v1.21 or higher is recommended)
- Helm v3.8 or higher for OCI support (Installation instructions)
kubectlinstalled and configured
Step 1: Start Cluster
If you have a cluster to work with, skip this step. Otherwise, start a Minikube cluster. Deployment instructions
Step 2: Download KServe Example Files
Download the example files from the Minimus examples repository:
wget -qO- https://github.com/minimusio/examples/archive/refs/heads/main.tar.gz | \
tar -xz --strip-components=2 "examples-main/kserve"Create a templates subdirectory:
mkdir templatesStep 3: Deploy KServe ModelMesh and KServe Proxy
Run the following command from your project directory to deploy KServe ModelMesh and KServe Proxy:
helm install kserve . \
--namespace kserve \
--create-namespace \
--values values.yamlWait a few minutes for the assets to initialize before checking that all Pods are up and running:
kubectl get po -n kserveVerify that the chart deployed the expected Minimus images:
kubectl -n kserve describe deploy kserve | grep Image:Technical Considerations
The KServe ModelMesh image provided by Minimus is a slim, security-hardened alternative to the public image. The images are largely interchangeable, with a few differences as noted below.
KServe ModelMesh built by Minimus:
- Runs as non-root by default as user 1000. The public image runs as user 2000.
- Drill down on the version specification tab to see the default user, listening ports, entrypoint, volumes, environment variables, etc.
The Payoff
A hardened, minimal image that will remain more secure for the long run and accrue vulnerabilities at a slower rate.
- See the risk reduction dashboard for a detailed CVE comparison over the past 30 days.
- Review the compliance report to see the default hardening and security configurations for the image.
Terms & Info
Trademark
This catalog is published by Minimus. All product names, logos, and marks, other than those belonging to Minimus, shown are owned by their respective rights holders and appear here only to identify the open source software each image contains. Minimus claims no ownership of those marks and implies no affiliation with, endorsement by, certification by, or sponsorship by any rights holder.
Disclaimer
Images are provided "as-is" without warranty of any kind. "Hardened" refers to the security configuration applied at the time of build and does not constitute a guarantee of ongoing security or absence of vulnerabilities. The free tier is provided without support, SLA, or guaranteed patching timelines. Security updates may be applied to paid subscriptions before or instead of free tier images. By pulling or using any image you agree to our Terms of Use.