Comment by RandallBrown
1 month ago
I've only used AI pretty sparingly, and I just use it from their websites, but last time I tried all 3 only the code Google generated actually compiled.
No idea which version of their models I was using.
1 month ago
I've only used AI pretty sparingly, and I just use it from their websites, but last time I tried all 3 only the code Google generated actually compiled.
No idea which version of their models I was using.
Same experience for me. Gemini generates by far the most usable code. Not "good code", obviously, but a decent enough foundation to build on. GPT in particular just spits out code for obsolete libraries, uses deprecated features, hallucinated methods etc. etc. It was a case for the trash bin every single time.
On the other hand, Gemini failed BADLY when I tried to give it a "summarize the data in this CSV" task. Every response was completely wrong. When pressed about which rows the answers were based on, 100% of the rows were made-up, not present in the source file (interestingly, after about 10 rounds of pointing this out, Gemini suddenly started using the actual data from the uploaded file). GPT's answers, on the other hand, matched manual verification with Excel.