Seth/mortdecai-gateway
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Semver rename: mortdecai:0.4.0, mortdecai:0.5.0

Browse Source 
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Seth Freiberg
2026-03-20 21:37:36 -04:00
parent adeda6dd84
commit af5cb4df2a
4 changed files with 10 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2 -2
View File
@@ -157,12 +157,12 @@ Response:
```bash ```bash
curl -X POST http://gateway:8434/admin/update-model \ curl -X POST http://gateway:8434/admin/update-model \
-H "Authorization: Bearer $KEY" \ -H "Authorization: Bearer $KEY" \
-d '{"url": "https://mortdec.ai/dl/v5/mortdecai-v5.gguf", "name": "mortdecai-v5"}' -d '{"url": "https://mortdec.ai/dl/v5/mortdecai-0.5.0.gguf", "name": "mortdecai:0.5.0"}'
``` ```
**Manual update**: Run the update script: **Manual update**: Run the update script:
```bash ```bash
./update-model.sh https://mortdec.ai/dl/v5/mortdecai-v5.gguf mortdecai-v5 ./update-model.sh https://mortdec.ai/dl/v5/mortdecai-0.5.0.gguf mortdecai:0.5.0
``` ```
## Response Metadata ## Response Metadata
gateway.py
+2 -2
View File
@@ -216,7 +216,7 @@ def _calc_marginal_cost(duration_seconds):
return marginal_watts, energy_wh, cost return marginal_watts, energy_wh, cost
def _track_request(tokens_in, tokens_out, duration_seconds, model="mortdecai-v4"): def _track_request(tokens_in, tokens_out, duration_seconds, model="mortdecai:0.4.0"):
"""Track a completed inference request and record in ledger.""" """Track a completed inference request and record in ledger."""
marginal_watts, energy_wh, cost = _calc_marginal_cost(duration_seconds) marginal_watts, energy_wh, cost = _calc_marginal_cost(duration_seconds)
@@ -461,7 +461,7 @@ class GatewayHandler(BaseHTTPRequestHandler):
def _handle_model_update(self, body): def _handle_model_update(self, body):
"""Download a new GGUF from a URL and reload the model. """Download a new GGUF from a URL and reload the model.
Request: {"url": "https://mortdec.ai/dl/...", "name": "mortdecai-v5"} Request: {"url": "https://mortdec.ai/dl/...", "name": "mortdecai:0.5.0"}
This is opt-in — the gateway operator must enable ALLOW_MODEL_UPDATES=true. This is opt-in — the gateway operator must enable ALLOW_MODEL_UPDATES=true.
""" """
if os.environ.get("ALLOW_MODEL_UPDATES", "false").lower() != "true": if os.environ.get("ALLOW_MODEL_UPDATES", "false").lower() != "true":
setup.sh
+3 -3
View File
@@ -5,8 +5,8 @@
set -e set -e
MODEL_URL="${MODEL_URL:-https://mortdec.ai/dl/m4gguf/mortdecai-v4.gguf}" MODEL_URL="${MODEL_URL:-https://mortdec.ai/dl/m4gguf/mortdecai-0.4.0.gguf}"
MODEL_NAME="mortdecai-v4" MODEL_NAME="mortdecai:0.4.0"
echo "=== Mortdecai Gateway Setup ===" echo "=== Mortdecai Gateway Setup ==="
echo "" echo ""
@@ -70,7 +70,7 @@ else
# Create Modelfile # Create Modelfile
cat > models/Modelfile << 'MEOF' cat > models/Modelfile << 'MEOF'
FROM /models/mortdecai-v4.gguf FROM /models/mortdecai:0.4.0.gguf
TEMPLATE """{{- if .Messages }} TEMPLATE """{{- if .Messages }}
{{- if or .System .Tools }}<|im_start|>system {{- if or .System .Tools }}<|im_start|>system
{{- if .System }} {{- if .System }}
update-model.sh
+3 -3
View File
@@ -1,12 +1,12 @@
#!/bin/bash #!/bin/bash
# Update Mortdecai model to a new version # Update Mortdecai model to a new version
# Usage: ./update-model.sh [url] [name] # Usage: ./update-model.sh [url] [name]
# Example: ./update-model.sh https://mortdec.ai/dl/m5gguf/mortdecai-v5.gguf mortdecai-v5 # Example: ./update-model.sh https://mortdec.ai/dl/m5gguf/mortdecai-0.5.0.gguf mortdecai:0.5.0
set -e set -e
URL="${1:-https://mortdec.ai/dl/m4gguf/mortdecai-v4.gguf}" URL="${1:-https://mortdec.ai/dl/m4gguf/mortdecai-0.4.0.gguf}"
NAME="${2:-mortdecai-v4}" NAME="${2:-mortdecai:0.4.0}"
echo "=== Mortdecai Model Update ===" echo "=== Mortdecai Model Update ==="
echo " URL: $URL" echo " URL: $URL"