Comment by MrScruff

1 month ago

How do they do if you include the updated docs in the context?

You would need to remove the older docs first and still than it will hallucinate. Forcing the llm to open the doc webpage does produce some hallucinations as well. The more context you provide the worse it gets. And tbf inb4 most llms could migrate bootstrap to tailwindcss v3 without too much trouble (of course it fails to change tags when building css classes from multiple strings, but that’s fine) And I tried a lot of models. It just broke from one week to another

  • older docs are forever there. what it needs is more training data with new APIs. Actually, because older docs are there, you can ask to update some old code to newer versions automatically.

    Point is that it needs enough examples with a newer version. Also, reasoning models are pretty good at spotting which version they are using.

    (tested not with tailwind, but some other JS libs).