Dynamically sets queue depth limits based on latency