Skip to content
This page is a translation of the authoritative Chinese source and may lag behind.View the original

Overview dashboard ​

Overview is the landing page after logging into the console, providing a global view: resource counts, instance running status, gated-request monitoring, and time-series trend charts.

Entry: Console → Overview (visible to admin and monitor).

Summary cards ​

Four cards at the top, reflecting the current configuration scale in real time:

CardMeaning
Total upstreamsNumber of configured upstreams
Active protocolsNumber of protocol types in use
Active modelsNumber of configured models
Active access keysNumber of issued access keys

Instance panel ​

Shows the status of each running gateway instance, one row per instance:

InfoDescription
Instance ID8-character prefix (click to copy the full UUID)
Task statusR=running, P=crashed (highlighted red), S=stopped
Memory levelNormal / Warning / Pressure / Reclaim / Critical; shows used/limit, level ≥ Warning shows a ⚠ warning
Disk usageTotal disk usage (hover to view each storage breakdown)

The instance panel's status refreshes in real time: in a multi-instance deployment with Redis configured, a gracefully-drained instance disappears from the panel within about 1 second; a single-instance deployment without Redis refreshes via periodic polling with slightly higher latency.

Disk details (hover to expand) ​

Hover over "Disk usage" to expand detailed metrics for each storage area:

Log queue (by role: memory / drain / live):

  • Disk usage / limit
  • Write pointer position
  • Segment count × segment size
  • Retention floor
  • DB drain cursor position (drain role)
  • SSE consumer count and minimum cursor

Other storage areas:

  • Response body storage (used / limit)
  • Request body storage (used / limit)
  • Accumulator storage (used / limit)
  • Ingress spill storage (used / limit)

Gated-request panel ​

Shows requests currently queued or being processed (under memory pressure the gateway queues new requests):

ColumnDescription
TimeEnqueue time
InstanceThe processing instance ID (8 characters)
ClientAccess key name
MethodPOST, etc.
PathRequest path
StatusQueued / Active / Completed / Rejected (timeout or queue full)
ElapsedQueue waiting duration
  • By default, only requests in Active and Queued status are shown.
  • Click "Show all history" to see snapshots of Completed and Rejected.

Time-series charts ​

Two time-series charts at the bottom, supporting time-range presets: Today / 12h / 24h / 2d / 7d / 30d.

Token usage chart (left): a line chart grouped by model, with hover showing each model's input/output token breakdown. The legend shows the model name and total; click a legend entry to hide that line.

Request count chart (right): three lines for total / success / error, with hover showing the specific value of each metric.

FAQ ​

Q: The instance count in Overview doesn't match my deployment? Only instances currently processing requests are shown. Idle instances (no in-flight tasks) do not appear in the list.

Q: What if the memory level shows Critical? The gateway is actively reclaiming memory, which may affect request latency. Check for memory leaks or traffic spikes, and scale up if necessary.

Q: Gated requests stay Queued and never move? The gateway is under high memory pressure, and queued requests are waiting for processing resources. Check the memory level, and rate-limit or scale up if necessary.

Q: Time-series charts have no data? Time-series data comes from persisted statistics. If the gateway just started or the statistics feature is not enabled, the charts may be empty. Confirm that the statistics-related configuration is correct.

Next: Console login and roles for login and roles; Statistics for usage statistics; Log viewer for request details.