Mortdecai Gateway — authenticated Ollama proxy with power metering
- API key auth on all inference endpoints - Power/cost tracking: GPU TDP × inference time × electricity rate - Spending cap enforcement - Web dashboard with live stats - Docker compose for AMD ROCm (Strix Halo) or NVIDIA - Auto-setup script with GGUF loading - Tested against local Ollama Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,5 @@
|
||||
FROM python:3.11-slim
|
||||
RUN pip install --no-cache-dir requests
|
||||
WORKDIR /app
|
||||
COPY gateway.py .
|
||||
CMD ["python3", "gateway.py"]
|
||||
Reference in New Issue
Block a user