Comment by dvrj101

2 months ago

2b granite model can do this in first attempt

ollama run hf.co/ibm-granite/granite-3.3-2b-instruct-GGUF:F16 >>> how many b’s are there in blueberry? The word "blueberry" contains two 'b's.

1 comment

dvrj101

mdp2021 2 months ago

I did include granite (8b) in my mentioned tests. You suggest granite-3.3-2b-instruct, no prob.

  llama-cli -m granite-3.3-2b-instruct-Q5_K_S.gguf --seed 1 -sys "Count the words in the input text; count the 'a' letters in the input text; count the five-letter words in the input text" -p "If you’re tucking into a chicken curry or a beef steak, it’s safe to assume that the former has come from a chicken, the latter from a cow"

response:

  - Words in the input text: 18
  - 'a' letters in the input text: 8
  - Five-letter words in the input text: 2 (tucking, into)

All wrong.

Sorry I did not have the "F16" available