Comment by nl

This isn't true.

Companies pay lots of money for proprietary agentic trajectories which are used during RL. These are things like "Task: summarize stock levels for months end accounting" which then traces the task though using SAP to look at different SKU stock levels, exporting them and generating summary Excel spreadsheets.

This is very different to the "scrape the internet" datasets that a table stakes for training a LLM.

Xiaomi released a fairly developer-centric dataset like this here: https://huggingface.co/datasets/XiaomiMiMo/MiMo-V2.6-RL-oss

SpreadsheetRL is another fairly specialized dataset: https://spreadsheet-rl.github.io/