In this figure, the shared work queue can be a source of contention where threads all try to pull from it. I think in reality, if there are a lot of worker threads, rate limiting individual threads might be a good way to reduce the potential for contention on the shared queue.
In this figure, the shared work queue can be a source of contention where threads all try to pull from it. I think in reality, if there are a lot of worker threads, rate limiting individual threads might be a good way to reduce the potential for contention on the shared queue.