Comment by camel_gopher

3 hours ago

Clever but that’s not how we measure latency.

When it comes to UX, perceived latency is king.

  • The perceived latency starts from keydown, not keyup. Redefining latency to start at keyup reduces measured latency, not perceived latency, and delaying the visual display to keyup makes perceived latency strictly worse, not better. Even sticking with the keyup definition, just displaying the result as soon as it is available gives the possibility of negative (defined) latency.

    • I think you don't fully understand. They aren't just doing a search based on the key being pressed down. They already did a search based on the previous characters that returned results for all possible next characters. So by the time you type a second character it just checks results locally from the search that had likely already been returned from when you had typed the previous character.

      3 replies →

  • What you said might be true and yet what OPs AI agent did wasn't measure latency of the service nor calculated a p99 for it.