← Back to context Comment by bikelang 13 hours ago Wow - actually pretty astonishing how fast their inference is. So fast it feels fake? 1 comment bikelang Reply qingcharles 11 hours ago Yeah, when you find fast inference like that it almost feels like the answer arrives before you hit return. Now imagine it running locally with no server round-trip.
qingcharles 11 hours ago Yeah, when you find fast inference like that it almost feels like the answer arrives before you hit return. Now imagine it running locally with no server round-trip.
Yeah, when you find fast inference like that it almost feels like the answer arrives before you hit return. Now imagine it running locally with no server round-trip.