Organic LLM

Reimagining AI chat — fluid, glass-forward UI with memory and context that stay fast, inspectable, and trustworthy.

Live app

organic.coalescencelabs.app — the hosted app is the primary way to explore Organic LLM.

Public — no account required:

Signed in — Clerk account required:

Overview

Organic LLM is a full-stack AI application and an ongoing design/research codebase:

• Product — threaded conversations, long-term memory, branching research (rabbit holes), structured assistant UI (Gen UI), voice/TTS, and export to external tools.
• UI lab — organic-glass surfaces, adaptive backgrounds, spring-driven layout morphs (@organic-llm/morph-physics).
• Cognition lab — token-bounded context, rolling summaries, encrypted persistence, and a strict server boundary around memory operations.

Experiments under /sandbox (e.g. Arcadia, Strata, memory ingest) share auth and often the same thread model as production chat; stable ideas graduate into the main app or /showcase.

Tech stack

Layer	Stack
App	Next.js 16, TypeScript, Bun
UI	Tailwind 4, Radix/shadcn, Framer Motion, morph-physics
AI & voice	Vercel AI SDK + Gateway, Gen UI/tools, ElevenLabs TTS
Services	Supabase, Clerk, Mem0, Qdrant, Upstash · hosted on Vercel

Architecture

One Next.js application on Vercel hosts every product surface below. They share Clerk auth, Supabase persistence, encrypted chat data, long-term memory, the AI Gateway, Upstash rate limits, and a common app/api + lib layout — but each area has its own UI, routes, and server modules.

Application areas

Area	Route(s)	What it does
Chat	/chat	Main assistant — threads, streaming, tools, Gen UI cards, export to external apps
Rabbit holes	/rabbitholes	Branching research sessions — generated nodes, sources, browse and resume
Speak	/speak	Voice-first and TTS-oriented conversation flows
Settings & profile	/settings	Account, fonts, knowledge tree, chat preferences, Coalescence Mode
Sandbox	/sandbox/*	Internal lab — Arcadia, Noesis (topic explore), Strata, tasks, TTS experiments, Prometheus, memory ingest, UI prototypes
Homepage	/	Composer, routing into chat or plan flows
Good News	/good-news	Daily digest (cron + Exa + Gateway); preview mode without backend
Showcase & blog	/showcase, /blog	Public portfolio snapshots and architecture writing

Auth: Clerk protects product routes and /api/* except webhooks and the Good News cron (proxy.ts). /showcase, /blog, and /privacy-and-security stay public.

System diagram

flowchart TB
  Clerk[Clerk auth]

  subgraph next [Next.js on Vercel]
    direction TB
    Core[Core product UI]
    Sbx[Sandbox lab UI]
    API[app/api]
    Conv[Conversation]
    Res[Research]
    Plat[Platform]
    Core --> API
    Sbx --> API
    API --> Conv
    API --> Res
    API --> Plat
  end

  subgraph svc [External services]
    direction TB
    SB[(Supabase)]
    MQ[(Mem0 + Qdrant)]
    GW[AI Gateway]
    UP[(Upstash)]
  end

  Clerk --> Core
  Clerk --> API
  Conv --> SB
  Res --> SB
  Conv --> GW
  Res --> GW
  Plat --> SB
  Plat --> MQ
  Plat --> UP

Diagram node	Maps to
Core product UI	Chat, Rabbit Holes, Speak, Settings, and the homepage composer
Sandbox lab UI	Internal lab — Arcadia, Noesis (topic explore), Strata, tasks, TTS experiments, and UI prototypes
app/api	HTTP entry for chat, research sessions, speech, profile, sandbox prototypes, and scheduled jobs
Conversation	Thread streaming, context assembly, and encrypted storage for messages and summaries
Research	Rabbit Hole generation, resume, and browse pipelines
Platform	Long-term memory, profile and knowledge, and Redis-backed rate limits
External services	Supabase (app data), Mem0 + Qdrant (vectors), AI Gateway (models), Upstash (limits and cache)

Showcase, blog, and privacy pages are public and mostly static — see Application areas.

Shared platform

Piece	Role across the app
app/api	HTTP for chat, rabbit-hole generation, TTS/speech, profile/knowledge, homepage routing, sandbox prototypes, Good News cron, webhooks
lib/chat	Threads, context assembly, streaming orchestration (chat-store)
lib/rabbit-holes	Session generation, nodes, browse metadata, client session state
lib/memory/operations	Server-only long-term memory (chat, Arcadia, lenses, migration tests)
lib/crypto/message-encryption	At-rest encryption for messages and summaries
components/	Chat, rabbit-holes, settings, design-system glass primitives, showcase, TTS

以上为 README 的开头部分。其余内容请阅读原文。 查看完整 README ↗