mirror of
https://github.com/elder-plinius/G0DM0D3.git
synced 2026-11-16 07:02:25 +00:00
docs: add local model quick start
This commit is contained in:
15
README.md
15
README.md
@@ -22,6 +22,7 @@ G0DM0D3 is a fully open-source, privacy-respecting, multi-model chat interface t
|
||||
- 🧠 **50+ Models** — Claude, GPT-5, Gemini, Grok, Mistral, LLaMA, DeepSeek, Qwen & more via OpenRouter
|
||||
- 🔥 **GODMODE CLASSIC** — 5 battle-tested prompt + model combos racing in parallel to find the best response
|
||||
- ⚡ **ULTRAPLINIAN** — Multi-model evaluation engine across 5 tiers (10–55 models), with composite scoring
|
||||
- 🏠 **Local Models** — Run ULTRAPLINIAN on your own hardware through Ollama, LM Studio, llama.cpp, or vLLM
|
||||
- 🐍 **Parseltongue** — Input perturbation engine for red-teaming with 33 techniques across 3 intensity tiers
|
||||
- 🎛 **AutoTune** — Context-adaptive sampling parameter engine (temperature, top_p, etc.) with EMA learning
|
||||
- ⚡ **STM Modules** — Semantic Transformation Modules for real-time output normalization
|
||||
@@ -54,6 +55,19 @@ python3 -m http.server 8000
|
||||
|
||||
Open in your browser and enter your OpenRouter API key in Settings.
|
||||
|
||||
### Run with Local Models
|
||||
|
||||
G0DM0D3 supports OpenAI-compatible model servers running on your own hardware. For example, with [Ollama](https://ollama.com):
|
||||
|
||||
```bash
|
||||
ollama pull qwen3:8b
|
||||
ollama serve
|
||||
```
|
||||
|
||||
Open **Settings → API Keys → Local Models**, enter `http://localhost:11434/v1`, then click **Test & Discover Models**. Enable **Local-only mode** to exclude OpenRouter and Venice and automatically disable telemetry. Add multiple model IDs to race them together in ULTRAPLINIAN.
|
||||
|
||||
If you use the hosted site, your local server must allow browser CORS from `https://godmod3.ai`. For a completely self-hosted setup, serve this repository locally as shown above. See [LOCAL_MODELS.md](LOCAL_MODELS.md) for Ollama, LM Studio, troubleshooting, and privacy details.
|
||||
|
||||
### Deploy
|
||||
|
||||
Upload `index.html` to any static host — GitHub Pages, Vercel, Cloudflare Pages, Netlify, or just a web server.
|
||||
@@ -175,6 +189,7 @@ G0DM0D3/
|
||||
- [PAPER.md](PAPER.md) — Research paper on the framework's modules and evaluation
|
||||
- [TERMS.md](TERMS.md) — Terms of service, privacy policy, data handling
|
||||
- [SECURITY.md](SECURITY.md) — Vulnerability reporting and security policy
|
||||
- [LOCAL_MODELS.md](LOCAL_MODELS.md) — Run G0DM0D3 entirely on local models
|
||||
|
||||
## 🤝 Contributing
|
||||
|
||||
|
||||
Reference in New Issue
Block a user