← Back to context

Comment by gazchop

3 months ago

How else are you going to load a hideously incorrect AI summary block without your initial page latency being through the roof?

10 comments

gazchop

Reply
Joeri  3 months ago

You could probably get it working with declarative shadow dom, streaming in the AI generated content at the end of the html document and slotting it into place. There are no doubt a lot of gotchas but at first glance it seems feasible. Here’s a demo I found of something like that: https://github.com/dgp1130/out-of-order-streaming

  • ptx  3 months ago

    The example repo is a little confusing to me, since it seems to use client-side JS to demonstrate that it doesn't need client-side JS: "It bootstraps a service worker and [...] No client-side JavaScript!"

    But I guess the point is that the code in the service worker could have been on the server instead?

    The trick seems to be using a template element with a slot and then slotting in the streamed content at the end. But you could probably also do it using just CSS to reposition the content from the bottom to the top, similarly to how many websites handle navigation menus, assuming that the client supports CSS.

    • Joeri  3 months ago

      Doing it with css would only be visual positioning, so would have accessibility issues. Slotted content can have accessibility issues as well, but it is probably more solvable because screen readers will see it “slot in” at the right point in the document.

bythreads  3 months ago

Iframes lazy

Object content as lazy

Embed lazy

Image lazy

Link rel=import (not support that widely though)

Heck if you wanted to get REALLY cute you go use multipart-mixed-replace headers.

Or SSE

  • DanielHB  3 months ago

    You could use some simple CSS tricks (like flex-direction: column-reverse) to make the end of the HTML render above the search results and just keep appending the AI generated text to the HTML without closing the connection.