tritonserver-vllm-backend

Updated 8 hours ago

Versions

Browse available versions organized by version lines.

Line latest

2 versions·End of life date is unavailable

Updated

version

Pull URL

vulnerabilities

exploitability

Compressed size

Updated today

26.07

Vulnerabilities

193

Exploitability-

Compressed size7132.98 MB

26.07 dev

Vulnerabilities

193

Exploitability-

Compressed size7146.31 MB

tritonserver-vllm-backend 26.07

Updated 8 hours ago·

7132.98 MB / 7185.27 MB

Vulnerabilities

193

Tags

User

root

Ports

8000/tcp8001/tcp8002/tcp

Environment variables

LD_LIBRARY_PATH=/usr/share/vllm-cu130/.venv/lib/python3.12/site-packages/torch/libNVIDIA_DRIVER_CAPABILITIES=compute,utility,videoNVIDIA_VISIBLE_DEVICES=allPATH=/opt/tritonserver/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/binPYTHONPATH=/usr/share/vllm-cu130/.venv/lib/python3.12/site-packagesSSL_CERT_FILE=/etc/ssl/certs/ca-certificates.crtTCMALLOC_RELEASE_RATE=200

Entrypoint

/opt/nvidia/nvidia_entrypoint.sh

CMD

Volumes

Working directory

/opt/tritonserver

Stop signal

Configuration

1234567891011121314151617181920

{
  "Env": [
    "LD_LIBRARY_PATH=/usr/share/vllm-cu130/.venv/lib/python3.12/site-packages/torch/lib",
    "NVIDIA_DRIVER_CAPABILITIES=compute,utility,video",
    "NVIDIA_VISIBLE_DEVICES=all",
    "PATH=/opt/tritonserver/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
    "PYTHONPATH=/usr/share/vllm-cu130/.venv/lib/python3.12/site-packages",
    "SSL_CERT_FILE=/etc/ssl/certs/ca-certificates.crt",
    "TCMALLOC_RELEASE_RATE=200"
  ],
  "Entrypoint": [
    "/opt/nvidia/nvidia_entrypoint.sh"
  ],
  "ExposedPorts": {
    "8000/tcp": {},
    "8001/tcp": {},
    "8002/tcp": {}
  },
  "WorkingDir": "/opt/tritonserver"
}