Comment by pmw

4 months ago

Related: https://github.com/haykgrigo3/TimeCapsuleLLM

> A language model trained from scratch exclusively on data from certain places and time periods to reduce modern bias and emulate the voice, vocabulary, and worldview of the era.

Discussed here: https://news.ycombinator.com/item?id=46590280

2 comments

pmw

Gander5739 4 months ago

Or https://news.ycombinator.com/item?id=46319826 (897 points, 431 comments)

whythismatters 4 months ago

TFA mentions some other interesting endeavors in this space:

>We have been excited to see a proliferation of vintage LM projects, including Ranke-4B, Mr. Chatterbox, and Machina Mirabilis.