Comment by aand16
11 hours ago
> You can also add `ngram-mod`, but after `draft-mtp`
It looks like there's a hardcoded preference, CLI order is not important.
(speculative.cpp:1322-1381): common_get_enabled_speculative_configs converts the types vector to a bitmask (order-independent). Then configs are added in a hardcoded priority order:
ngram-simple
ngram-map-k
ngram-map-k4v
ngram-mod
ngram-cache
draft-simple
draft-eagle3
draft-mtp
(speculative.cpp:1557-1603): common_speculative_draft iterates impls in the hardcoded priority order. Once an impl produces a draft for a sequence, later impls skip that sequence.
Interesting.