Compute Threshold Scaling
Compute-Based scaling increased the number of Agent instances based on a given agents compute exceeding a % utilization threshold. For high compute processes this can increase throughput if a significant number of requests are being handled.
Last updated