It's a bug, not sure why it suddenly started happening because I did not push any changes to the production server in the last days.
I suspect this has to do with new caching behavior of new server. I'll disable that post cache and let's see if that resolves the issue.