Comment by mdp2021

2 months ago

I did include granite (8b) in my mentioned tests. You suggest granite-3.3-2b-instruct, no prob.

  llama-cli -m granite-3.3-2b-instruct-Q5_K_S.gguf --seed 1 -sys "Count the words in the input text; count the 'a' letters in the input text; count the five-letter words in the input text" -p "If you’re tucking into a chicken curry or a beef steak, it’s safe to assume that the former has come from a chicken, the latter from a cow"

response:

  - Words in the input text: 18
  - 'a' letters in the input text: 8
  - Five-letter words in the input text: 2 (tucking, into)

All wrong.

Sorry I did not have the "F16" available

0 comments

mdp2021

Reply