Comment by srameshc
15 hours ago
So does that mean if Heretic is used for models like Deepseek and Qwen it can talk about subjects 1989 Tiananmen Square protests, Uyghur forced labor claims, or the political status of Taiwan. I am trying to understand the broader goals around such tools.
That's an interesting testing case, not for the political aspect, but for the data aspect. One would assume that the totality of "sensitive" data (especially in chinese) that gets thrown into the training dataset is quite limited. Getting a model that wasn't trained on such data (presumably) to actually talk about it would be an interesting exercise. Tho I'd suggest doing it with smaller models first.
Yes, you can also achieve this, presumably less efficiently, with Lora training.
the models already talk about it just fine if you load them up yourself, only the web api from official deepseek has these issues because they are required to do so by law.
That is not the case.
I just tested this with Deepseek in Nvidia's AI sandbox and in Groq (so the inference was performed in the US) and it happily told me what happened on June 4, 1989. Stop spreading disinformation.
2 replies →