{"id":42947690,"user":"ttyprintk","time":1738759358,"time_ago":"2 years ago","type":"comment","content":"

https://huggingface.co/simplescaling","comments":[{"id":42948229,"user":"anentropic","time":1738762414,"time_ago":"2 years ago","type":"comment","content":"

and: https://github.com/simplescaling/s1","comments":[{"id":42948419,"user":"mettamage","time":1738763262,"time_ago":"2 years ago","type":"comment","content":"

When you're only used to ollama, how do I go about using this model?","comments":[{"id":42949013,"user":"davely","time":1738766203,"time_ago":"2 years ago","type":"comment","content":"

I think we need to wait for someone to convert it into a GGUF file format.

However, once that happens, you can run it (and any GGUF model) from Hugging Face![0]

[0] https://huggingface.co/docs/hub/en/ollama","comments":[{"id":42949696,"user":"mettamage","time":1738768858,"time_ago":"2 years ago","type":"comment","content":"

So this?

https://huggingface.co/brittlewis12/s1-32B-GGUF","comments":[{"id":42963726,"user":"mettamage","time":1738858128,"time_ago":"2 years ago","type":"comment","content":"

I ran it, so far it seems like a pretty good model, especially locally.","comments":[],"comments_count":0,"level":4,"url":"item?id=42963726"},{"id":42950875,"user":"withinboredom","time":1738772914,"time_ago":"2 years ago","type":"comment","content":"

oh god, this is terrible!

I just said "Hello!" and it went off the rails.","comments":[{"id":42953945,"user":"delijati","time":1738784339,"time_ago":"2 years ago","type":"comment","content":"

why how what? can you add a sample prompt with output ?","comments":[{"id":42954195,"user":"withinboredom","time":1738785351,"time_ago":"2 years ago","type":"comment","content":"

In my original prompt, it gave me back multiple greetings in various languages. In this example, it gave me back just multiple greetings:

>>> hello!

Hello there! I'm here to help with any questions you might have. How can I assist you today? If you're asking a question, feel free to provide some\ndetails about what you need help with. I'll do my best to answer your question or guide you through the process. Just let me know!

<|im_start|>think

The user has asked "hello! " and provided no further information.\nAnswer here is a direct response to the user's request for information, which was essentially just a greeting. The appropriate response is to greet\nback and offer assistance.

<|im_start|>answer

Answer:

Hello! How can I assist you today? If you have a question or need help with something specific, feel free to ask. I'm here to support you!

<|im_start|>think

<|im_start|>answer

The user's message was "hello!" and there was no other information provided. The appropriate response is a greeting back and an offer of assistance.

<|im_start|>answer

Answer:

Hello! How can I assist you today? If you have a question or need help with something specific, feel free to ask. I'm here to support you!

<|im_start|>think

The user has greeted with "hello!" An appropriate response involves acknowledging the greeting and offering assistance. This could involve asking how\nwe can help them or what they'd like guidance on.

<|im_start|>answer

Answer:

Hello! How can I assist you today? If you have a question or need help with something specific, feel free to ask. I'm here to support you!","comments":[],"comments_count":0,"level":6,"url":"item?id=42954195"}],"comments_count":1,"level":5,"url":"item?id=42953945"}],"comments_count":2,"level":4,"url":"item?id=42950875"}],"comments_count":4,"level":3,"url":"item?id=42949696"},{"id":42950032,"user":"fl0id","time":1738769951,"time_ago":"2 years ago","type":"comment","content":"

you can load the safetensors with ollama, you just have to provide a modelfile. or wait for someone to do it. It will in theory also quantize it for you, as I guess most ppl cannot load a 129 GB model...","comments":[],"comments_count":0,"level":3,"url":"item?id=42950032"}],"comments_count":6,"level":2,"url":"item?id=42949013"}],"comments_count":7,"level":1,"url":"item?id=42948419"}],"comments_count":8,"level":0,"url":"item?id=42948229"}],"comments_count":9,"url":"item?id=42947690"}

Comment by ttyprintk