Chapter 12. Configuring API key authentication

Procedure

1. Start the inference server with API key authentication:

   $ podman run --rm -it \
     --device nvidia.com/gpu=all \
     --security-opt=label=disable \
     --shm-size=4GB -p 8000:8000 \
     -v ./rhaii-cache:/opt/app-root/src/.cache \
     registry.redhat.io/rhaii/vllm-cuda-rhel9:3.4.0 \
     --model RedHatAI/Llama-3.2-1B-Instruct-FP8 \
     --api-key "<your_api_key>"

2. Send a request with the API key in the Authorization header:

   $ curl http://localhost:8000/v1/chat/completions \
     -H "Content-Type: application/json" \
     -H "Authorization: Bearer <your_api_key>" \
     -d '{
       "model": "RedHatAI/Llama-3.2-1B-Instruct-FP8",
       "messages": [{"role": "user", "content": "Hello!"}]
     }'