Compute Threshold Scaling
Last updated
Last updated
Compute-Based scaling increased the number of Agent instances based on a given agents compute exceeding a % utilization threshold. For high compute processes this can increase throughput if a significant number of requests are being handled.