• Greyghoster@aussie.zone
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    There is this insane amount of investment in AI built around LLMs that threatens the entire world. People worry about the bubble bursting but think AI is the ant’s pants without considering that the LLM is a dead end. None of the AI companies are going to achieve Artificial Intelligence. That’s why they will actually implode, their systems aren’t intelligent.

    • kreskin@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      30 days ago

      It wont be a real AI, but itll be just enough to kill off a lot of the software industry.

        • gwl [he/him]@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          0
          ·
          29 days ago

          A true Turing Machine, obviously

          One that when given input will give the correct output, every time, without fault or stalling, in a timeframe that is quick

          • HereIAm@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            29 days ago

            A Turing machine has nothing to do with AI. Pretty much any computer today can emulate one, the only thing lacking is infinite memory.

        • kreskin@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          30 days ago

          Real ai to me would mean true agency. And an entity which has its own goals and relationship to its world.

          • Regrettable_incident@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            29 days ago

            Yeah. I wonder if it might be difficult to identify something that reaches that point? I suppose genuine creativity might be an indication of intelligence? Or a desire to reprogram itself? I dunno, I’ve recently read Peter Watts blindsight and it kind of made me reconsider the relationship between consciousness and intelligence.

            • smiletolerantly@awful.systems
              link
              fedilink
              English
              arrow-up
              0
              ·
              29 days ago

              If someone truly believes LLMs are sentient, then they must under no circumstances prompt them even once; that would be murder.

                • smiletolerantly@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  29 days ago

                  An LLM is a stateless stochastic function ran over your prompt (plus whatever system prompt) as input.

                  If you genuinely believe that the LLM is conscious, that means every time the function stops running (i.e. stops producing output tokens), the consciousness ends.

                  This is far closer to death than to, say, sleep, because prompting again doesn’t “wake” the LLM, it just runs the function again, from the top; as if a digital twin was given a transcript of the previous conversation and asked to take it from here.

                  (Obviously, “murder” was somewhat tongue-in-cheek, and this doesn’t even remotely meet any legal definition of murder. I was mostly poking fun at people who think LLMs are alive, without thinking through the implications. Personally, I think the idea that LLMs are alive/conscious/sentient is very often linked to not understanding that LLMs are not, in fact, a constantly-running ghost in the shell, thinking about and remembering things in the background.)

  • Modern_medicine_isnt@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    29 days ago

    “more clear that the real future of AI is small language and open-weight models running on local desktop computers” So where are we with those smaller models? I haven’t been following them. Are they any good?

    • iocase@lemmy.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      29 days ago

      Qwen3.8-flash-next is making waves since its near frontier or frontier (according to some i havent used it) that can be run on an ancient 8GB video card (12GB or more is recommended. 16GB is best.) with around 32GB of RAM using Strata.

      Strata

      It’s a mixture of experts MoE model, so while it’s around 66GB (depending on which quantization you decide to run) you’re only really using about 6B parameters per token processed, meaning the VRAM requirements are a lot lower.

      I personally don’t see the value proposition in paying $4/1M tokens when i can generate around 30tok/s on 500W of power. I pay ¢13/kWh so to generate 1M output tokens takes me 9.25 hours and costs $0.60.

      I’m also running an ancient video card and have a new one in the mail. If i got 200 tok/s even at higher power use i’m still a fraction of the cost of paying for API access and I want that GPU for other things regardless.

      I feel lile medium and large businesses have a strong incentive to rent or buy inference using open weight models for a fraction the cost of paying OpenAI or Anthropic. Especially if you can pre load them with everything about your org to make them better suited for internal use.

      The vast majority of uses can use a open weight locally run model. I think you would only want to pay for frontier models for really complex tasks with lots of steps, and even then there are usually ways to be smart about how you task agents with work to get better output and use less money.

      • bashibazouk@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        26 days ago

        The other issue is we are finding out that what you do in the AI cloud is logged. It can be subpoenaed, can be sent to police if it fails a safety check, or even stolen if the mathematicians fears are real. It is certainly being used to further train models…

  • 1984@lemmy.today
    link
    fedilink
    English
    arrow-up
    0
    ·
    30 days ago

    Yes any time now. Just like in 2022, 2023, 2024, 2025…

    Nvidia is not even overpriced. If anything, it’s underpriced because it’s a 5 trillion dollar company and the market doesn’t believe it will be able to keep growing.

    I dont believe this technology will become anything actually smart. It’s still just text prediction. But it’s good enough for a lot of usecases.

  • eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    The funniest part is that the thing that could actually make AI useful at scale might be what wrecks the investment thesis: cheap, local, open weight models. Wall Street funded a trillion dollar server farm to discover that sometimes the answer is a smaller model running on your laptop. The technology might win while the investors lose. Nevertheless, companies such as Google, Amazon, and Microsoft – as well as Nvidia and AMD – are a very long way from simply going under.

    • Rhaedas@fedia.io
      link
      fedilink
      arrow-up
      1
      ·
      1 month ago

      Too big to fail? I think I heard that once.

      I just can’t see things continuing like this, there has to be a plateau reached at some point. Higher or lower. Exponential growth isn’t sustainable in anything.

    • zurohki@aussie.zone
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Google, Amazon and Microsoft will be fine.

      Oracle, though. It’s possible they’ll actually die. And wouldn’t that be tragic.

      • scytale@piefed.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        I think NVIDIA has a higher chance of survival because they’re the ones actually producing something tangible (GPUs) that is still needed even if openweight models prevail.

        • moustachio@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          29 days ago

          This isn’t going to happen. They’re not the banks, and they’re pretty universally hated in the country.

          • Dead_or_Alive@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            29 days ago

            When the AI bubble pops it’s going to take down the banks.

            There is a lot of private credit dollars loaned to data centers and the banks are heavily invested in private credit.

            It’s a house of cards priced for perfection just waiting for one of the big 5 to have a slightly off quarter.

    • TheStaffmaster@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      29 days ago

      I’d suggest that the 1929 stock market crash get an entire unit in elementary school, High school, and every economics course in college. Do the same for the 89’ crash and the Dot com Bubble. Really drill it into these young entrepreneurs how Speculating in the stock market NEVER EVER leads to anything good. It’s a Faustian bargain. The consequences WILL arrive; not a matter of “if” but “when.”

    • floquant@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      29 days ago

      Yeah, Bloomberg though. Not saying that they are great, but it’s among those that Wall Street bros read to decide what to buy and sell

  • switcheroo@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    29 days ago

    AI could be used to save our planet from catastrophic climate change, to problem solve ways to improve things, to do hard labor so that people don’t have to… but nah let’s use it to make assholes with too much money get more money! That’s fantastic

    • benjirenji@slrpnk.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      29 days ago

      We already got solutions. What’s missing is the courage and incentives to actually adopt them by political leaders and the larger public. If AI would replace our politicians maybe it could help, otherwise it’s just the latest proof that there’s plenty of money around to transform the economy into whatever we want it to be. I guess we prefer chat bots over carbon neutral.

    • RememberTheApollo_@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      29 days ago

      They didn’t listen to the scientists.

      Somehow I think AI would go from “Super Intelligence” to “that libtard tree hugging computer made of parts from commie Chy-na” as soon as it told them to do something legit that would inconvenience them or disagree with their narrative.

  • Pratai@piefed.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    30 days ago

    There is no AI bubble, just like there is no housing bubble. It’s here to stay. This is the sad truth.

          • Pratai@piefed.ca
            link
            fedilink
            English
            arrow-up
            0
            ·
            28 days ago

            My friend let me tell ya. There still unaffordable. But who knows, I heard on the internet that the bubble might pop someday.

            • prole@lemmy.blahaj.zone
              link
              fedilink
              English
              arrow-up
              1
              ·
              27 days ago

              2008 was nearly a decade ago. People will always need shelter. Is it really that surprising that the market recovered over the years?

              But at what cost? Who owns those properties now? Private investment firms.

    • finalarbiter@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      29 days ago

      An economic bubble doesn’t require that the assets suddenly disappear upon the bubble popping.

      The 2008 financial crisis was caused in part by the popping of a real estate bubble in the US. Those properties didn’t magically evaporate after the bubble popped, though many families couldn’t afford to keep their homes.

      In the same manner, nobody is really suggesting that LLMs will suddenly disappear after the AI bubble pops, only that they will probably be proven to be significantly less profitable and get scaled back.

      • redballooon@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        29 days ago

        In the same manner, nobody is really suggesting that LLMs will suddenly disappear after the AI bubble pops

        There is a significant portion of AI haters who think exactly that, for some reason.

        • finalarbiter@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          1
          ·
          29 days ago

          I mean, it’s likely that a good chunk of these hyperscale data centers and some of these big corporate LLMs will run out of cash and close shop. We’ll probably see a big pivot to much more efficient models that are local and/or purpose-built, not unlike what the Chinese are already doing.

    • Modern_medicine_isnt@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      29 days ago

      Look, none of use should be cheering for a full on pop of the buble. It will hurt all industries. And we know the oligarchy has insulated themselves in ways that will ensure they feel very little pain. It will be all the workers who will feel it. As for data centers, I don’t think we need the bubble to burst to fight that. Lots of jurisdictions are already banning them. That is what we should be cheering for.

      • TipRing@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        29 days ago

        While I am not cheering for the bubble to pop, the longer it goes on the worse it will be so the sooner it happens the better.

        • Modern_medicine_isnt@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          28 days ago

          I dunno. The market affect is mostly perception. I mean why should unrelated stocks suffer when AI companies fall, yet they do. So I don’t think the length of time actually impacts the severity of the crash. But I’m no economist. That’s more of a “I don’t see why”, rather than a “no it won’t”

          • TipRing@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            28 days ago

            The main issue is that increasingly AI companies are making up a big portion of index funds which are required by law to be purchased by mutual fund managers and thus part of retirement accounts, so value will be evaporated out of retirees accounts. The larger the bubble the more the impact.
            Also note that the only reason the US is not in recession right now is due to AI market “growth” so the GDP correction that follows will cause companies who have invested in the technology (not just AI companies, but most of the Fortune 500) to contract. The fallout will be unpredictable, but the most likely scenario is layoffs. Further, the Fed will be reluctant to cut interest rates, because inflation is extremely high due to tariffs, so the one lever the government has to stave off the recession has been compromised by the current administration. So the recession will be deeper and worse with a longer recovery than it would otherwise have.

            So why care? Because grandma’s retirement will disappear, a bunch of people will be laid off and the levers available to mitigate the impact have already been pulled. Oh and inflation will get worse when our government bails out AI tech bros to the tune of $1T.

            • Modern_medicine_isnt@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              26 days ago

              So I agree on the impact, and on the why care. But I’m not seeing why waiting long makes it worse. Based on what you said, waiting longer could help if it can hold out until this tariff war is over (one way or the other). Then it might be possible to lower interest rates to soften the impact. If it can hold out for a whole new administration even, that could help a lot. Though that is also what would likely trigger it, as a new administration will likely restore regulations that have been relaxed, increasing costs to business. But I would rather pay that price at that time with that administration than this one.

              • TipRing@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                26 days ago

                The bubble is growing over time. It will have a more severe impact in two years than it would if it happened tomorrow.

                • Modern_medicine_isnt@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  26 days ago

                  That makes logical sense, but I am looking for a more solid explanation. Again, I am not saying it isn’t, I am asking how could I say that to someone and then back it up with a solid why.