Seth/mortdecai-gateway
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Mortdecai Gateway — authenticated Ollama proxy with power metering

Browse Source 
- API key auth on all inference endpoints
- Power/cost tracking: GPU TDP × inference time × electricity rate
- Spending cap enforcement
- Web dashboard with live stats
- Docker compose for AMD ROCm (Strix Halo) or NVIDIA
- Auto-setup script with GGUF loading
- Tested against local Ollama

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Seth Freiberg
2026-03-20 19:26:43 -04:00
commit c5865feb35
7 changed files with 561 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.env.example
+6
View File
@@ -0,0 +1,6 @@
# Mortdecai Gateway Configuration
API_KEY=mk_change_this_to_a_real_key
GPU_TDP_WATTS=54
SYSTEM_OVERHEAD_WATTS=30
ELECTRICITY_RATE=0.15
SPENDING_CAP=10.00