AIAny
AI Deploy2026
Icon for item

codex-lb

Pools multiple ChatGPT/Codex accounts behind a local OpenAI-compatible proxy and dashboard — provides request load balancing, per-account usage/cost tracking, API-key management, and configurable routing strategies.

Introduction

Most friction when integrating hosted LLM access comes from quota limits, per-account rate controls, and client tooling that expects a single OpenAI endpoint. codex-lb addresses that operational gap by pooling multiple ChatGPT/Codex accounts and exposing a single OpenAI‑compatible endpoint with usage accounting and a management UI.

What Sets It Apart
  • Account pooling with usage-aware routing: multiple selection strategies (capacity-weighted, relative availability, usage-weighted, round-robin, etc.) let operators steer traffic by quota headroom and recent usage rather than blind round-robin. So what: smooths consumption across accounts and reduces sudden quota exhaustion on a single account.
  • OpenAI/Codex-compatible frontends: exposes both /v1 (OpenAI Responses-style) and backend-api/codex routes and integrates with Codex CLI, OpenCode, OpenClaw and standard OpenAI SDK clients. So what: existing clients need minimal or no changes to switch to a pooled backend.
  • Per-account accounting and API-key management: tracks tokens, cost, 28‑day trends and supports per-key rate limits, model allowlists, expirations, and dashboard-created keys. So what: helps operators enforce limits and audit usage centrally.
  • Production deployment primitives: first-run bootstrap token, support for SQLite or PostgreSQL, Docker/Helm manifests, multi-replica session bridge and observability hooks. So what: easier to run behind a reverse proxy or in Kubernetes for remote teams.
Who It's For & Trade-offs

Great fit if you operate multiple upstream ChatGPT/Codex accounts and need a single, OpenAI-compatible façade for tooling or teams — for example, internal developer tools, CLI workflows, or small multi-tenant setups. It’s also useful when clients require the Responses API semantics (reasoning state) that Codex-style endpoints provide.

Look elsewhere if you require a turnkey, fully managed multi-account service or if you plan to drive high-volume, policy-risky traffic: codex-lb is an operator-managed proxy that depends on you maintaining account credentials and staying within upstream terms of service. Also note the default security posture: API-key auth is disabled by default (local requests allowed), so remote deployments must enable key auth or place the service behind network/reverse-proxy access controls.

Where It Fits

Positioned as an operational glue layer — not a model host. It does not replace upstream provider billing or guarantee account safety; instead it reduces client integration friction and adds per-account telemetry and routing controls, making it practical to scale usage across several provider accounts without rewriting client code.

Information

  • Websitegithub.com
  • AuthorsSoju06
  • Published date2026/01/07

Categories

More Items

GitHub
AI Deploy2018

Serves machine learning and deep learning models for cloud, data center, edge and embedded environments. Supports multiple frameworks and backends, dynamic and sequence batching, HTTP/gRPC APIs, Docker deployment and NVIDIA-optimized runtimes.

GitHub
AI Video2025

Automatically transfers YouTube videos to AcFun and bilibili with an end-to-end pipeline: downloading, ASR, subtitle translation and QC, AI-generated metadata, content moderation, and automated uploads; includes a web dashboard and monitoring.

Provides a portable C++ inference runtime to deploy embodied AI models (vision–language–action and world–action) on heterogeneous robot hardware, enabling latency-first batch-1 closed-loop control. Key features include modular multi-rate layers, fused low-latency inference, and extensible head/IO plugins.