Comment by MrDrMcCoy

2 days ago

Here: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/tree/main

Excuse me, but thats a direct link you've just sent. I asked where I can find the links. I like to believe in the source of truth.

They shared a lot of links, I'm struggling to find yours. Where did yours come from ?

Who is Unsloth AI? Have they modified the model ? Is this really the source of truth ?

Do you see how steep the barrier for entry is to do anything right ?

unslothai is not a name qwen has ever used. So you're sharing a link to a model that isn't from the owner, while saying it's the owner's. I'm not comfortable with that, and I want AI to be a better tool.

  • > Excuse me, but thats a direct link you've just sent. I asked where I can find the links. I like to believe in the source of truth.

    You asked where to find the GGUF files of this model for direct download and I provided it. Almost all useful model files that can be downloaded are hosted on Huggingface.

    > They shared a lot of links, I'm struggling to find yours. Where did yours come from ?

    I went to Huggingface, went to the Unsloth org, as they tend to be the best, went to the Model page, and went to the "Files and versions" tab.

    > Who is Unsloth AI? Have they modified the model ? Is this really the source of truth ?

    Unsloth AI is a very popular, highly reputable organization that takes upstream model files, performs some optimization, and provides models in various formats. Apart from speed tweaks, they do not modify the models. They also provide useful benchmarks, copious documentation for local execution, and a Studio application for easy execution and post-training of models.

    > Do you see how steep the barrier for entry is to do anything right ?

    No. Searching for this information is not difficult. The llama.cpp documentation and guides that Unsloth provide are all you need. Search engines can take you further if you want.

    > unslothai is not a name qwen has ever used. So you're sharing a link to a model that isn't from the owner, while saying it's the owner's. I'm not comfortable with that

    Qwen also provides models in GGUF format on Huggingface, but they will not be as performant. Even when first-party GGUFs are available, most people will prefer quants from Unsloth or a few other popular optimizer accounts.

    > I want AI to be a better tool.

    Best of luck. Your attitude and unwillingness to even try and learn on your own when people have tried helping have burned my good will, and this is as far as I'm willing to carry you.

    • > I went to Huggingface, went to the Unsloth org, as they tend to be the best, went to the Model page, and went to the "Files and versions" tab.

      "I went to youtube, gmail, ycombinator, deliveroo, then I went to another site I randomly chose, because they're the best, duh"

      Okay.

      > Unsloth AI is a very popular, highly reputable organization that takes upstream model files

      And How am I supposed to know that arriving to huggingface as a new user? Enlighten me.

      > Qwen also provides models in GGUF format on Huggingface

      Cool.. Why don't they share em because I genuinely cant find em, I'm dumb.

      > Your attitude and unwillingness to even try and learn on your own when people have tried helping have burned my good will

      Well, I'm willing, but not from people who I might burn good will. Gracious. You do you.

      4 replies →