• Em Adespoton@lemmy.ca
    link
    fedilink
    English
    arrow-up
    29
    ·
    9 days ago

    It’s worse than that even… frontier models now have guardrails restrictive enough that I can’t use them for legitimate work. And the ones that DO work have token prices at exorbitant rates, and chew through them like there’s no tomorrow.

    Meanwhile, I can download Qwen3 and run it on my own hardware, and it’s about as good as the last generation US model without the annoying guardrails.

    Hmm… which model am I going to choose to use?

        • brucethemoose@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          7 days ago

          It’s a mixed bag TBH. The issue is that Qwen 3.8 27B is so good.

          It depends on the quant you are running though, and the way you are running it. If you have 16GB or less VRAM and a generous amount of CPU RAM, and you are running a regular GGUF instead of something exotic, Qwen next is probably better, with the right hybrid inference engine.