← Back to context

Comment by aand16

11 hours ago

> You can also add `ngram-mod`, but after `draft-mtp`

It looks like there's a hardcoded preference, CLI order is not important.

(speculative.cpp:1322-1381): common_get_enabled_speculative_configs converts the types vector to a bitmask (order-independent). Then configs are added in a hardcoded priority order:

ngram-simple

ngram-map-k

ngram-map-k4v

ngram-mod

ngram-cache

draft-simple

draft-eagle3

draft-mtp

(speculative.cpp:1557-1603): common_speculative_draft iterates impls in the hardcoded priority order. Once an impl produces a draft for a sequence, later impls skip that sequence.