MY trillion $Dollar Project is finally OUT!
youtu.be
Use code PEWDIEPIE at the link below to get an exclusive 60% off an annual Incogni plan: https://incogni.com/pewdiepie⛵ Check out Odysseus: https://pewdiepie...

cross-posted from: https://sh.itjust.works/post/61139432

I seriously can’t believe how much progress he’s made for the FOSS community. He actually might take a bite out of the big 3’s profits with this

    • appauled@sh.itjust.worksOPEnglish
      25·
      23 days ago

      I kinda loved his “you should self host to decentralize from big tech” and “run graphene and Linux to avoid data collection” content, but idk what the local ai stuff is any good for

      • Encrypt-Keeper@lemmy.worldEnglish
        211·
        23 days ago

        It’s good for the same things machine learning has always been good for. Language synthesis and analysis. Selfhosting something like Paperless for document management. It actually has a very rudimentary learning engine for document classification for a long time but feeding document content to a local AI model for organization tagging is very useful.

      • dropped_the_chief@lemmy.worldEnglish
        2·
        21 days ago

        If you use AI for a lot of small things, then you can offload the tasks to a locally run server.

        Or if you see it as a feature you plan on using for a long time and don’t want to have to keep paying big tech for the privilege of using AI, and hell, you already have a nice graphics card, it’s perfect.

  • onlinepersona@programming.devEnglish
    291·
    23 days ago

    How many GPUs do you even need to have a usable, self-hosted AI? It looks like he has 6 on his rig. Probably each costs 2k or something. That’s not peanuts. I have a 12GB VRAM card. It probably can’t generate anything in any meaningful amount of time. Which brings me to the question: who is this for?

    Regardless, impressive what he vibe-coded there.

    • Dultas@lemmy.worldEnglish
      3·
      23 days ago

      I think in one video it looked like 16 cards. I think he did multiple bifurcations of the pcie lanes. I think he is / was using it for protein folding as well.

    • apftwb@lemmy.worldEnglish
      21·
      23 days ago

      I can tell you from personal experience, 8GB is not enough for a snappy experience. Maybe if you had it setup to churn through data overnight. My RTX 3060 Ti was not happy.

    • new_world_odor@lemmy.worldEnglish
      21·
      23 days ago

      I have a rx5600xt (6gb), 32gb ram, ryzen 3600. System hasn’t been updated since i built it during covid. QwenV3-vl35B is the heftiest thing I can run, it gets around 2 tokens/sec, in LM studio. It’s easier than most people seem to think.

  • Matt@lemmy.mlEnglish
    15·
    23 days ago

    He’s done the main quest. Now he’s doing the side quests.

  • somethingDotExe@lemmy.worldEnglish
    136·
    23 days ago

    I love that guy. Remember hating him back in the days when he got popular by sitting and yelling while playing games. But damn the guy matured and put out epic content the past 10 years or so.