Comment by blowski

Kudos to the OP for doing it, and for anyone using WordPress, it's pretty easy for you to do it too:

https://wordpress.org/plugins/amp/