Skip to content

Roadmap

文档版本: 1.1.P0 最后更新: 2026-05-21 Git 提交: 61384b4a 作者: Lincoln

This document outlines the future development plans and feature roadmap for the JAiRouter project.

Project Vision

JAiRouter aims to become the best open-source AI model service routing gateway, providing users with:

  • Unified Access: One gateway to access all AI model services
  • Intelligent Routing: Smart load balancing based on multiple strategies
  • High Availability: Robust fault tolerance and recovery mechanisms
  • Ease of Use: Simple configuration and comprehensive documentation
  • High Performance: Support for large-scale concurrency and low-latency responses
  • Observability: Comprehensive monitoring, logging, and distributed tracing

Current Version Status

✅ v2.6.11 LTS (Current Stable)

Release Status: Released (2026-04-17) Maintenance Period: Until 2028-05

Completed Features

  • ✅ Multi-tenancy support
  • ✅ API Key authentication
  • ✅ JWT Token support
  • ✅ OAuth 2.0 integration
  • ✅ Role-Based Access Control (RBAC)
  • ✅ Request/response data obfuscation
  • ✅ Security audit logging
  • ✅ H2 embedded database
  • ✅ PostgreSQL/MySQL support
  • ✅ Redis cache integration
  • ✅ Prometheus metrics collection
  • ✅ Grafana dashboard templates
  • ✅ Distributed tracing (Zipkin/OpenTelemetry)
  • ✅ Complete Docker deployment
  • ✅ Kubernetes deployment support

Code Quality

  • ✅ Checkstyle code standards
  • ✅ SpotBugs static analysis
  • ✅ JaCoCo test coverage reports
  • ✅ 700+ unit tests
  • ✅ E2E integration tests

🎯 v2.7.x - Performance Optimization Series (Q2 2026)

Completed

VersionDateMain Content
v2.7.02026-04-20Package structure refactoring, 6 service modules
v2.7.12026-04-21auth module独立 (116 files)
v2.7.22026-04-22config module独立 (~50 files)
v2.7.32026-04-23router module上 (adapter/loadbalancer)
v2.7.42026-04-24router module下 (circuit breaker/rate limit)
v2.7.52026-04-25monitor module独立 (98 files)
v2.7.62026-04-26persistence module独立 (49 files)
P v2.7.72026-04-27common module独立 (96 files)
v2.7.82026-04-28controller grouping optimization
v2.7.92026-04-29package structure completion

Performance Improvements

  • Route flow optimization: 20-50%
  • Memory usage reduction: 15%
  • Startup time reduction: 30%

⏸️ v3.0 - Microservices Architecture (Indefinitely Postponed)

Status: ⏸️ Postponed

The v3.0 microservices architecture transformation has been indefinitely postponed as the current monolithic architecture meets all requirements.


Feature Roadmap

Adapter Extensions

Supported ✅

AdapterTypeStatus
GPUStackChat/Embedding/Rerank
OllamaChat/Embedding
vLLMChat
XinferenceChat/Embedding/Rerank
PLocalAIChat/Embedding
OpenAIChat/Embedding
Azure OpenAIChat/Embedding
Anthropic ClaudeChat
阿里云百炼Chat/Embedding
腾讯P云混元Chat
百度智能云Chat

Planned 📋

  • 📋 Google Gemini (v2.8.x)
  • 📋 Cohere API (v2.8.x)
  • 📋 AWS Bedrock (v2.9.x)

Load Balancing Strategies

Implemented ✅

  • ✅ Random
  • ✅ Round Robin
  • ✅ Weighted Round Robin
  • ✅ Least Connections
  • ✅ IP Hash
  • ✅ Consistent Hash

Planned 📋

  • 📋 Latency-based
  • 📋 Cost-based
  • 📋 Model Capability-based

Rate Limiting Algorithms

Implemented ✅

  • ✅ Token Bucket
  • ✅ Leaky Bucket
  • ✅ Sliding Window
  • ✅ Warm Up
  • ✅ Adaptive Rate Limiting

Planned 📋

  • 📋 Distributed Rate Limiting
  • 📋 User-based Rate Limiting
  • 📋 API Key-level Rate Limiting

Monitoring and Observability

Implemented ✅

  • ✅ Prometheus metrics
  • ✅ Grafana dashboards
  • ✅ Health check endpoints
  • ✅ Basic alert rules
  • ✅ Distributed tracing (Zipkin/OpenTelemetry)
  • ✅ Structured logging

Planned 📋

  • 📋 Business metrics analysis
  • 📋 Cost analysis
  • 📋 Custom alert rules

Technical Architecture

Current Architecture (v2.6.x)

Monolithic App → Modular Design → Reactive Programming

Architecture Evolution

PhaseVersionStatus
Foundationv0.1 - v0.3✅ Complete
Securityv0.4✅ Complete
Monitoringv0.5✅ Complete
Performancev2.7.x✅ Complete
Configurationv2.8.x🔄 In Progress
Maintainabilityv2.9.x📋 Planned
Microservicesv3.0⏸️ Postponed

Tech Stack

Core Technology

  • Backend: Spring Boot 3.5.5 + WebFlux (Reactive)
  • Frontend: Vue 3 + TypeScript + Element Plus
  • Database: H2 (embedded) + R2DBC
  • Cache: Redis (optional)
  • Monitoring: Prometheus + Grafana
  • Tracing: OpenTelemetry + Zipkin

Data Storage

  • Default: H2 embedded database
  • Production: PostgreSQL / MySQL
  • Cache: Redis (optional)

Performance Targets

VersionRPSLatency (P95)AvailabilityConnections
v2.6.x5k< 50ms99.95%5k
v2.7.x10k< 30ms99.95%10k
v2.8.x20k< 20ms99P.P99%20k
Target100k+< 10ms99.99%100k+

Community Development

Current Status

  • GitHub / Gitee dual platform hosting
  • Complete user and API documentation
  • Chinese/English documentation support
  • MkDocs static website

Development Goals

  • Active developer community
  • Regular version releases
  • More adapter support
  • Complete plugin system

Release Cycle

Version TypeCycleDescription
LTS24 monthsLong-term stable support
Feature1-2 monthsNew feature iteration
PatchAs neededBug fixes and security updates

Contributing

Code Contributions

  • Feature development and bug fixes
  • Performance optimization and refactoring
  • Test case writing
  • Code review

Documentation Contributions

  • User documentation improvements
  • API documentation updates
  • Tutorial and example writing
  • Multi-language translation

Feedback Channels


Risks and Challenges

Technical Risks

  • Performance bottlenecks: Performance challenges at scale
  • Compatibility: Multi-version API compatibility maintenance
  • Security: Security vulnerabilities and attack protection

Market Risks

  • Increased competition: Competition from similar products
  • Technology changes: Challenges from rapid AI technology development
  • User needs: Rapidly changing user requirements

Mitigation Strategies

  • Continuous technical innovation and optimization
  • Active community building and maintenance
  • Flexible product strategy adjustments
  • Comprehensive quality assurance system

Summary

JAiRouter will continue to uphold the open-source spirit and is committed to providing users with the best AI model service routing solution. We welcome community participation and contributions to jointly promote the project's development and progress.

Recent Focus (2026)

  1. ✅ Complete v2.7.x performance optimization series
  2. 🔄 Advance v2.8.x configuration management optimization
  3. 📋 Plan v2.9.x maintainability improvements
  4. 📋 Explore v4.0 new features

Long-term Vision

  1. Become the standard in AI model routing
  2. Build a complete ecosystem
  3. Achieve enterprise-level commercial success
  4. Drive industry technology development

Last Updated: May 19, 2026

For any suggestions or ideas, feel free to communicate with us via GitHub Discussions.