Comment by grog454
3 years ago
My first experience with AWS was around 2013 when I accidentally left a (cheap) ec2 instance running for months after I was done experimenting with it. Support refunded me no questions asked. Fast forward 2 years and that experience was an important factor in my decision to run servers costing 6 figures annually with AWS over their competition.
I came to write a very similar story involving a lazy error on my part (no error checking on a shutdown ec2 instance script, resulting in a 64 Xeon, 8 Nvidia Tesla server running 24/7 for about a month) and an astronomical bill resulting.
I had a rudimentary batch job system running. Since I was charged for each power event, I wanted to minimize the power state changes and just queued up the work that needed GPU acceleration until there was enough to justify the cost of at least an entire hour and two power state events. When the cheap, small, always on instance received all the work output from the giant beast server, it would then send a power down command using the aws cli. Yeah, like I said, I was lazy so I just sent off the request and small server just went on about it’s business. Oops.
Like I told the aws billing rep, it would have bankrupted me, ending that venture. I asked that, since it is all virtualized, that while yes I had the virtual hardware provisioned for all that time, if they could get someone to look at the actual utilization they would see it was essentially none. They got back to me and in a day or so to let me know they had forgiven the entire amount.
AWS support actually listen, do real work, and very often it seems, do what is in the best interest of the customer even as it works directly against the company’s bottom line.
When I was early in my career freelancing my AWS account was shut down for no payment for over a year, more than half a decade later I re-opened it through support and they wouldn’t even let me pay my old bill.
I’ve been able to reduce reserved instances when the market has turned unpredictable.
AWS isn’t a pushover, not even a little bit. Dealing with them externally has just been a good experience with professional understanding and a flexible business sense.