← Back to context

Comment by tootyskooty

5 days ago

I gave it a shot with periplus.app :). Not perfect by any means, but it's a different UX than chat so you might find it interesting.

11 comments

tootyskooty

Reply
diggan  4 days ago

Looks like a great start, played around with it a bit yesterday and today, I've basically been doing the same with my own CLI but the UI you came up with helps a great deal with navigation and resuming learning :)

One issue I found is the typical "LLM accuracy" issue, with seemingly no recurse. I tried to generate some courses for topics I already know well, just to review how accurate it is, and while popular subjects (ex: "Electronic Music Fundamentals") it gets most of the details correct, less popular subjects (ex: "Scene Transitions with Octatrack") are riddled with errors (both in the "docs" and the quizes/exercises), and I cannot find a way of correcting/adjusting/reporting the errors.

  • tootyskooty  4 days ago

    Yeah it's still hard to deal with LLM gaps (fwiw Study mode would also be prone to this). I do try to catch the super obvious stuff and put up a disclaimer but it's far from perfect.

    I had some prototypes basing the generations in websearch but the APIs are still super expensive on that front + the models tend to overindex on the results.

danenania  5 days ago

This looks super cool—I've imagined something similar, especially the skill tree/knowledge map UI. Looking forward to trying it out.

Have you considered using the LLM to give tests/quizzes (perhaps just conversationally) in order to measure progress and uncover weak spots?

  • tootyskooty  5 days ago

    There are both in-document quizzes and larger exams (at a course level).

    I've also been playing around with adapting content based on their results (e.g. proactively nudging complexity up/down) but haven't gotten it to a good place yet.

    • danenania  5 days ago

      Nice, I've been playing with it a bit and it seems really well done and polished so far. I'm curious how long you spent building it?

      Only feedback I have so far is that it would be nice to control the playback speed of the 'read aloud' mode. I'd like it to be a little bit faster.

      6 replies →