Comment by hiddencost

2 years ago

Google did it. Amazon did it. Plenty of others did. What do you think they were doing before recurrent neural networks?

100 million USD?

No.

I'd believe $40 for the energy cost, $120 for very slightly increased wear on their hard drives, and $400 for one engineer's 20% time project for one week.

And that's if it was trained on Google's entire internet cache rather than, say, just a Wikipedia snapshot from 2004, which sounds like the kind of thing that Google might have set as a pre-interview coding challenge.