Open Completion

• repo: opencompletion.com <https://opencompletion.com>_

• demo: demo.opencompletion.com <https://demo.opencompletion.com>_

Chatroom applicationallows users to join rooms, send messages, & interact with multiple language models in real-time. Backend written with Flask & Flask-SocketIO for real-time web socket streaming. Frontend uses minimal HTML, CSS, & JavaScript to provide an interactive user interface.

Features

• A home page that is an empty chat: type, & your first message starts a solo chat (only you, signed in) or a multiplayer chatroom anyone with the link can join. Its sidebar lists your chats & public ones, you at the bottom.
• Real-time messaging between users in a chatroom.
• Ability to join different chatrooms with unique URLs.
• Integration with language models for generating room titles and processing messages.
• Syntax highlighting for code blocks within messages.
• Markdown rendering for messages.
• Code execution: Run code blocks from chat in 42+ programming languages via unsandbox.
• Text-to-speech: Read model replies aloud with multiple voice options.
• Commands to load and save code blocks to AWS S3.
• Database storage for messages and chatrooms using SQLAlchemy.
• Migration support with Flask-Migrate.
• Attach files to any message (picked, dropped or pasted), up to OPENCOMPLETION_UPLOAD_MAX_MB (default 7) each & OPENCOMPLETION_UPLOAD_LIMIT per address (default 30/600). Models read text & code files & see images (vision models). Bytes are stored once per content in SQLite (blob_store.py, tables blob & attachment; run make upgrade-db on an existing database, make init-db on a new one).
• Speak instead of typing: the mic records in the browser & our server transcribes through SPEECH_ENDPOINT_n's /audio/transcriptions (model SPEECH_STT_MODEL, default whisper-1; OPENCOMPLETION_TRANSCRIBE_LIMIT per address, default 30/600).
• A Stop button ends the reply streaming in a chat; what it wrote stays.
• Email OTP authentication with solo (only you) chat support
• Fork any model reply into a new chat holding the conversation up to it, limited per address (OPENCOMPLETION_FORK_LIMIT, default 10/600: 10 forks per 10 minutes; 0 turns it off). Behind a proxy set OPENCOMPLETION_PROXY_HOPS to how many proxies front us (default 1, our Caddy; 0 uses the socket address).
• Edit & resend your own message: the edit replaces it & everything after it for everyone in the room & the models answer again. Nothing is deleted: the earlier branch is kept, hidden (run make upgrade-db; see Upgrading an existing database).
• A ⋯ menu on every chat (sidebar, Rooms, Search): rename, refresh title (a model titles it afresh), pin (kept in this browser), archive & delete (owner only).
• Follow-up suggestions under each reply, from the model that answered (OPENCOMPLETION_FOLLOWUPS=off turns them off), and a ↓ button back to the newest message.
• Models search the web & read pages as they answer (keyless search over five vendors' free tiers; docs/TOOLS.md). A guest's search runs in their own browser, never on our network; only emails on OPENCOMPLETION_SERVER_EGRESS_USERS use our server, & only they may have a page fetched. OPENCOMPLETION_WEB_SEARCH=off & OPENCOMPLETION_WEB_CRAWL=off turn them off.
• Models run code as they answer, on unsandbox: one-off runs with no network for anyone allowed to run code (files they make come back as attachments), & for those same egress emails a sandbox per chat that keeps its files & can hand a task to uncloseai-cli, which reaches our models through a token made for that one sandbox, never our keys (docs/TOOLS.md).
• Installable as an app on phones & desktops (/manifest.webmanifest, named by OPENCOMPLETION_BRAND).
• Room archiving and owner management

Requirements

• Python 3.11 or newer (CI runs 3.11, 3.12, 3.13, 3.14 & 3.15)
• make; everything else installs into venv/ from requirements.txt
• At least one OpenAI-compatible model endpoint (vLLM, Ollama, llama.cpp, ...)

Installation

1. Clone this repository::

   git clone https://github.com/russellballestrini/opencompletion.git cd opencompletion

   Git Remotes: This repo is configured to push to both GitHub and unturf simultaneously. The origin remote has two push URLs:

   • GitHub: [email protected]:russellballestrini/opencompletion.git
   • unturf: ssh://[email protected]:2222/engineering/unturf/opencompletion.com.git

2. Create venv/ with every dependency (re-run after a pull; it only reinstalls when a requirements file changed)::

   make venv

3. Copy vars.sh.sample to vars.sh & fill in your endpoints and keys (vars.sh is gitignored; never commit it)::

   cp vars.sh.sample vars.sh

   Chat replies sample at temperature OPENCOMPLETION_TEMPERATURE (0.6), OPENCOMPLETION_TOP_P (0.95) & OPENCOMPLETION_TOP_K (20; 0 = not sent), never greedily (greedy decoding loops reasoning models), are capped at OPENCOMPLETION_MAX_TOKENS (24576, thinking & answer together; 0 = no cap) & stop early when a model keeps repeating itself (OPENCOMPLETION_REPEAT_LIMIT, 8 repeats; 0 = off). OPENCOMPLETION_PRESENCE_PENALTY is sent when set (Qwen suggests up to 1.5 for quantized models that repeat). Thinking that passes OPENCOMPLETION_THINKING_BUDGET (16384 tokens; 0 = no budget) with no answer begun is stopped & the model answers from its notes, without thinking, in up to OPENCOMPLETION_ANSWER_TOKENS (8192). A server that refuses top_k, or a cap past its context, is asked again without it. A model's thinking is saved with its reply (run make upgrade-db).

This is the beginning of the README. Read the rest at the original. Read the full README ↗