Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library
← Back to context

Comment by qiine

2 days ago

what --no-context-shift is for ?

2 comments

qiine

Reply

pulse7  2 days ago

"--context-shift, --no-context-shift ... whether to use context shift on infinite text generation (default: disabled)"

From: https://github.com/ggml-org/llama.cpp/blob/master/tools/serv...

  • MrDrMcCoy  2 days ago

    That is obvious. Less obvious is what context shifting does and whether you want it or not.

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities