BookFreq AI Inference

OpenAI-compatible API endpoint powered by vLLM on Kubernetes.

Authenticate with basic auth to use the API:

curl -u user:pass https://bookfreq.com/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model":"Qwen/Qwen2.5-0.5B-Instruct",
      "messages":[{"role":"user","content":"hello"}]}'

Endpoints: /v1/models /v1/chat/completions /v1/completions

API Documentation | Health Check

Project

Daily News