2.6 KiB
Run G0DM0D3 with local models
G0DM0D3 can use any local server that implements the OpenAI-compatible
/v1/models and /v1/chat/completions endpoints. The local transport is
restricted to localhost, 127.0.0.1, and ::1.
Quick start with Ollama
-
Install Ollama and pull one or more models:
ollama pull qwen3:8b ollama serve -
In G0DM0D3, open Settings → API Keys → Local Models.
-
Enter
http://localhost:11434/v1as the base URL. -
Click Test & Discover Models.
-
Enable Local-only mode if no cloud requests or telemetry should run.
When using the hosted https://godmod3.ai page, Ollama must allow that browser
origin. Start Ollama with an origin configuration that includes
https://godmod3.ai, then restart the server. If you do not want to expose a
local endpoint to a hosted page, serve G0DM0D3 locally as described below.
Quick start with LM Studio
- Load a model in LM Studio.
- Open the Developer tab and start the local server.
- Enable browser/CORS access for the origin from which G0DM0D3 is loaded.
- Use
http://localhost:1234/v1in G0DM0D3 and click Test & Discover Models.
Run the interface locally
From the repository root:
python3 -m http.server 8080
Open http://localhost:8080, configure the local model endpoint, and enable
Local-only mode. In this mode G0DM0D3:
- excludes OpenRouter and Venice from every ULTRAPLINIAN race;
- disables metadata telemetry and clears pending telemetry events;
- uses local models for query classification, TASTEMAKER judging, refusal checks, the Pliny coaching pass, accuracy checks, and Liquid refinement;
- keeps conversations, settings, and keys in browser storage.
Multiple comma-separated model IDs can race together. Local-only mode uses the first configured model for helper/judge calls, so place the strongest local judge first. Image analysis works only when that model accepts OpenAI-compatible image message parts.
Troubleshooting
- Connection failed / Failed to fetch: start the local server and enable
CORS for the page origin (
https://godmod3.aior your local web origin). - No models returned: confirm
GET <base-url>/modelsreturns OpenAI-style{ "data": [{ "id": "..." }] }JSON. - Responses are slow: configure one model instead of several, disable coaching or Liquid refinement, or lower Max Tokens in Settings.
- Model rejects a parameter: update the local server or use its OpenAI-compatibility mode. G0DM0D3 sends standard chat-completion fields and omits cloud-specific reasoning controls for local requests.