Concurrency can be significantly less than the number of dynos
Another nasty consequence being that Heroku’s 30s request time limit, which used to be based on request time alone, is now based on request AND queue time. Which means that a fast request, taking say 2s, could still trigger an “H12” timeout error if it gets caught in a large queue at a dyno.
Which is exactly what happens — in our case, more than than a thousand times an hour.
To help improve the meaning of these lyrics, visit “Heroku's Ugly Secret” by James Somers (Ft. Andrew Warner, ATodd, Chrissy & LEMON) and leave a comment on the lyrics box