Serving Mix
serving_mix creates mixed execution pressure representative of requests with
different prompt and generation demands.
| Area | What it tests |
|---|---|
| Compute | Mixed projection-style work. |
| Memory | Synthetic request working-set reads. |
| Telemetry | Power, clocks, cache/DRAM behavior, and throttling. |
| Result | Synthetic requests per second. |
This is not an HTTP server or queueing benchmark. Measure TTFT, inter-token latency, and production concurrency using the actual serving stack separately.