Files
sub2api-cn-relay-manager/docs/2026-06-04-SLO_AND_OBSERVABILITY.md
phamnazage-jpg 492f33a129
Some checks failed
CI / Build & Test (push) Has been cancelled
CI / Lint (push) Has been cancelled
CI / Security Scan (push) Has been cancelled
CI / Docker Build (push) Has been cancelled
CI / Release (push) Has been cancelled
feat(vnext): complete vNext.1 release gate — default chain admission, idempotent init, user key skeleton
- DEFAULT_CHAIN_ADMISSION.md: reviewed and approved, real artifact refs added
- DEFAULT_DATA_IDEMPOTENT_RELEASE_GATE.md: reviewed and approved
- scripts/setup_default_data.sh: idempotent init with --dry-run/--apply/artifact
- scripts/test/test_default_data.sh: 4 test cases all pass
- scripts/acceptance/verify_user_key_self_service.sh: Phase 0 skeleton
- .gitignore: add generated artifact directories
2026-06-05 11:07:50 +08:00

2.0 KiB
Raw Blame History

SLO and Observability

日期2026-06-04 状态:待审核 适用版本vNext.3

目的

把 vNext 从“有脚本、有测试”提升到“有生产观测与发布门禁”。

观测维度

至少覆盖三层:

  1. 插件控制面
  2. 宿主入口
  3. 上游 provider

核心指标

路由与可用性

  • user chat success rate
  • pool success rate
  • provider route success rate
  • failover rate
  • sticky hit rate
  • cooldown active count

延迟

  • control plane P95/P99
  • host probe P95/P99
  • user-key chat P95/P99

错误分类

  • 429
  • 403
  • 5xx
  • cloudflare_blocked
  • auth_failed
  • host_protocol_mismatch
  • network_timeout

key 自助

  • key create success rate
  • first chat=200 conversion rate
  • denied access count
  • rotate/reset success rate

治理

  • pause hits
  • quota exhausted hits
  • manual override count

最小 SLO 建议

默认链路候选

  • 最近窗口 user-key chat success rate >= 95%
  • P95 latency <= 5000ms
  • 最近窗口无 auth_failed
  • 最近窗口无 cloudflare_blocked

key 自助

  • key create success rate >= 99%
  • first chat=200 conversion rate >= 95%

日志与 traces

至少要求:

  • request_id 贯穿 control plane / host probe / user-key probe
  • route_id / provider_id / model_pool_id 可关联
  • 错误分类写入结构化日志
  • 审计日志与业务日志分离

告警建议

P1 告警

  • 默认链路 success rate 连续低于阈值
  • user-key probe 连续失败
  • host protocol mismatch 激增
  • auth_failed 激增

P2 告警

  • failover rate 异常升高
  • sticky hit rate 异常下降
  • quota exhausted 快速增加

发布门禁

vNext.3 引入正式发布门禁前,至少要求:

  • 指标已可收集
  • 错误分类稳定
  • 默认链路 admission 文档与指标口径一致
  • 至少一轮真实环境回放/验证

与当前范围关系

本文件属于 vNext.3 设计文档。 当前 vNext.1 不进入实现,但必须在规划阶段明确其后续必备性,避免将来“功能可用但不可运营”。