UPDATE 2/15: Here's how to modify your application to make New Relic report dyno-level queue time
We wrote a gem called heroku-true-relic to get New Relic to show accurate request queue times
These new accurate queue numbers confirm the results of our simulations: we are currently running 250 dynos (monthly bill: $27,000) with an average throughput of ~11000 requests per minute
A simulation with those numbers estimates that the average queue time should be around 290ms, which is very close to the 324ms average New Relic now reports. We don’t have a ton of data yet with the accurate request queueing, but that’s pretty close!
To help improve the meaning of these lyrics, visit “Heroku's Ugly Secret” by James Somers (Ft. Andrew Warner, ATodd, Chrissy & LEMON) and leave a comment on the lyrics box