Damn, I hope this is not goodbye to uncensored models 😢

  • CosmoNova@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 months ago

    Remember, the whole AI scheme exists to take the very concept of ownership from us. This takeover is hostile.

    • cecilkorik@lemmy.ca
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 months ago

      Why do we need a centralized hub for AI models anyway? I’ve never figured this out. We flock to these big “friendly” fucking companies with obviously unsustainable business models trying to own and sell things that should be shared in a decentralized, democratized mesh anyway. AI models should all be distributed magnet links, not hosted files. Why do we do this to ourselves?

      The way things are going at Huggingface now, I imagine we probably will have to start building the infrastructure we need to handle AI models as distributed links sooner rather than later. Let the enshittification begin, we’ll move on to a different tactic for sharing AI models while cheerfully they squeeze cash out of people and businesses too lazy to adapt. Everything working as it should, I guess.

      • Avid Amoeba@lemmy.ca
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        2 months ago

        For real, this is the perfect application for torrent. If I were building a registry that had to have sustainable cost for an open source community it would use torrents as a file transfer backend. If I were building something that I was planning to sell to a monopoly firm that has monopoly money… HTTP and cloud storage all thw way! 😄

      • SorryQuick@lemmy.ca
        link
        fedilink
        English
        arrow-up
        0
        arrow-down
        2
        ·
        2 months ago

        Probably cause it’s a dumb comment, you people see conspiracies everywhere.

        • JigglySackles@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          2 months ago

          That was hardly conspiracy worthy. It’s a bit hyperbolic, but it’s a fairly legit concern. Big tech is not the friend of any consumer. And big tech buying literally anything ends up a net negative for the consumer and freedom of choice. There is evidence that tech oligarchs (openAI/Sam Altman) want to gatekeep even knowledge and charge a subscription to access it.

          Huggingface is now absolutely going to become pay to play. Maybe not day one, but it will happen. Just like all the other services out there that are now subscription based that were once free and offer little to justify the move. It’s also likely to drop AMD development or at least deprioritize it so hard they may as well.

          There are also movements in the industry that suggest these big tech companies want to push a move to thinclients connected to cloud services instead of local machines. This idea isn’t helped by companies like Sony stripping away physical media. Nor by the RAM manufacturing cartel colluding for overpricing and abandonment of consumer markets.

          Conspiracies are only conspiracies until they come to pass, and not all conspiracies are unfounded tripe like flat earthers etc.

        • BJW@lemmus.org
          link
          fedilink
          English
          arrow-up
          0
          arrow-down
          1
          ·
          2 months ago

          Correct. There’s no “laughing at the idiot” button, so the downvote button has to fill in.

  • melfie@lemmy.zip
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    The core llama.cpp maintainers also work at HF and will now work for Nvidia I guess. Llama.cpp is a pretty significant part of the local LLM stack, especially since other tools like Ollama and LMStudio are just GUIs built on top.

    Local LLMs have gotten to the point where they are a serious threat to Anthropic and OpenAI, and Nvidia has a lot of skin in the game. If Nvidia wanted to do some serious damage to local LLMs, they are now in a position to do so.

    I’m also imagining they may try to squeeze out support for other GPU vendors. I’m using an AMD 7900 XTX to run Qwen 3.8 27B that I downloaded from HF to run on llama.cpp, which currently works like a dream. The 7900 XTX is the only sanely priced 24GB GPU left in 2026 (under $1k vs. $2k, $3k, $4k for Nvidia 24-32GB cards). Combined with OpenCode or Pi, a setup like this basically eliminates the need to use Anthropic or OpenAI products in the same way Jellyfin eliminates the need to use streaming services.

    I’m sure Nvidia and their buddies don’t like one thing I’ve said in this comment and may very well be plotting to put a stop to it, so the community may need to step up our game and get our eggs out of the big tech basket.

    • Mwa@thelemmy.club
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      what if the LLAMA.CPP devs working at Nvidia improves CUDA support and keeps other vendor support.

      • adhdsergio@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        It would be great but they seem to favour server computing as that has the greatest margins. I have a feeling being the biggest company on the planet at $5tn is not enough.

  • Gsus4@mander.xyz
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    Ok, how come these public utility databases are owned to be sold like that eg gitgub, twitter without any regulator pushback? Oh yea…

  • flop_leash_973@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    2 months ago

    I would be less concerned about it being the end of uncensored models than I would be Nvidia finding ways to make sure there are no free models hosted there that work well on anything but Nvidia hardware for the foreseeable future.

  • frustrated_phagocytosis@fedia.io
    link
    fedilink
    arrow-up
    2
    ·
    2 months ago

    I fail to understand the use of the term open source when the resource itself can be bought by oligarchs. Like organic vegetables, or clean coal.

    • darkkite@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 months ago

      I’ve downloaded a terabyte worth of models and didn’t pay a cent. storage and bandwidth cost money

    • terabyterex@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 months ago

      They wont disappear. hugging face is two things. its a model repo and a compute provider. hugging face has paid plans to run models on their systems. nvidia will use this to run on their backend. this is how they plan to make money from hugging face. its in their best interest to keep the repo stuff as is.

  • DarkCloud@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 months ago

    They should put up a back up torrent of all the currently available models before transferring ownership. Thus opening the doors for future websites.

    NVIDIA is probably trying to shutdown the LLM-at-home market (which means you don’t need huge clouds of graphics cards or even an Internet connection). Sad day for people who like to control their data.

    • ThePowerOfGeek@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      2 months ago

      I heard somewhere they are buying it because their own development platform sucks. So they are going to replace it with hugging face.

      Which doesn’t preclude them from locking all the good stuff behind a subscription, of course.

    • boonhet@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      2 months ago

      Nvidia also sells super expensive graphics cards. They probably want you to buy a couple of 5090s or a Spark.

      They know they can’t shut down the entire self hosted LLM market but they can direct it towards using Nvidia GPUs by making sure llama.cpp devs don’t spend much time on ROCm support, etc. And they probably know that ClosedAI and Anthropic’s days on the frontier are limited.

  • negativenull@piefed.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    My question is what their motivation is.

    • Do they want to close down open models so more is directed at the frontier/closed companies (OpenAI/Anthropic)?
    • Or are they trying to diversify and push open models as a safety net for when the bubble bursts
  • Echo Dot@feddit.uk
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    2 months ago

    So they are just slapping random price tags on things now. It’s a database of AI questions. They have paid 13 billion dollars for a database, and everyone’s acting like that’s a perfectly rational sensible thing to do. No one in the financial industry has any sense anymore.

    A company that’s only product is something that people either don’t want or actively hate has paid an eye-watering amount of money for a database to train their product on, this training will have no effect whatsoever on whether people want it.

    I have this nice bridge with lots of training examples if anybody’s interested, 100 trillion dollars please

      • Echo Dot@feddit.uk
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        It’s an expensive toy that might become a viable product in a decade that doesn’t mean it’s a valuable company today. Irresponsible spending like this is exactly what led to the dot com bubble.

          • Echo Dot@feddit.uk
            link
            fedilink
            English
            arrow-up
            0
            ·
            edit-2
            2 months ago

            Yeah because it was impossible to Google things in the past. Every time anybody comes up with a use for AI it’s basically just automating something that isn’t even that hard for you to do. If you want to automate simple tasks that’s absolutely fine but it’s not the second coming as people keep insisting.

            Come back to me when an AI can actually add value to something, when it can do something that is not just automating a simple task, but it’s capable of doing things that humans are not. I keep being told that we’re only a few years away from the technological singularity, so wake me up when we actually get there.

            • BJW@lemmus.org
              link
              fedilink
              English
              arrow-up
              0
              ·
              2 months ago

              It saves immeasurable time. Your time may not be valuable, but mine is.

              • Echo Dot@feddit.uk
                link
                fedilink
                English
                arrow-up
                0
                arrow-down
                1
                ·
                2 months ago

                Yeah and another way to say that is my job is complicated enough they cannot be automated via lua script with ambition.

                Rather than being an ass wipe why don’t you tell us what you are immensely important and easily automatable job is. And then I guess you can go find a new career, or something.

          • Alcoholicorn@mander.xyz
            link
            fedilink
            English
            arrow-up
            0
            ·
            2 months ago

            What kind of research do llms actually help with?

            In my experience, if the answer can’t be found in the top google results, the AI simply makes shit up.

            • 1985MustangCobra@lemmy.ca
              link
              fedilink
              English
              arrow-up
              1
              ·
              2 months ago

              thats completely false when you only ask the llm a very basic question like “what color is the sun?” you need to talk to the model like its smarter than a google search engine. “what color is the sun? pull the data from scientific articles and other sites that study the sun”

              if you google the first question, you will have list of different pages, where if you use AI to search on your query, it will model an answer from thoese sources, with said sources linked, similar to a Wikipedia page.

              • Alcoholicorn@mander.xyz
                link
                fedilink
                English
                arrow-up
                0
                arrow-down
                1
                ·
                2 months ago

                There are thousands of papers on the color of the sun, its trivial to google a paper, if you need an LLM to do this, that’s on you. But if you ask it valve clearances for an indonesian motorbike in english, it will make it up, even though the service manual is available in Indonesian. If you ask it how to synthesize a chemical that nobody bothers to write about because its uninteresting or impossible, it will straight up lie.

                • 1985MustangCobra@lemmy.ca
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  2 months ago

                  i think that learning to prompt AI is somthing people lack as a skill and then call it bad and a liar like its some intelligence when it isn’t

            • Echo Dot@feddit.uk
              link
              fedilink
              English
              arrow-up
              0
              arrow-down
              1
              ·
              2 months ago

              The fact that it lies is so irritating, if it at least admitted that it didn’t know the answer it would at least be a useful search engine. The fact that it makes stuff up though means I always have to scroll past the AI summary, that I didn’t ask for, in order to actually go to the website to check the results myself, because I can’t trust it.

              • Alcoholicorn@mander.xyz
                link
                fedilink
                English
                arrow-up
                0
                arrow-down
                1
                ·
                2 months ago

                The worst part is that mostly lies for things that aren’t immediately obvious, so you ask it “what is the color of the sun” and it appears to work just fine, but the moment you use it for any real research, it will just fabricate things wholecloth.