Comment by realusername
11 hours ago
That argument is moot as distillation also requires a lot of hardware and software, if copying models was as easy as that, we would have hundreds of competing models.
11 hours ago
That argument is moot as distillation also requires a lot of hardware and software, if copying models was as easy as that, we would have hundreds of competing models.
No. Building models and distilling models both require the hardware and software. It doesn't mean building models is distillation.