• 0 Posts
  • 14 Comments
Joined 11 months ago
cake
Cake day: December 24th, 2025

help-circle





  • “AI” is certainly environmentally damaging and dangerous, and if it isn’t given new input, it quickly starts generating absolute crap, but I don’t agree with this statement:

    LLMs are simply not capable of producing new knowledge. They can only reproduce what’s in their training data. An LLM-based system, being a statistical model of its training data and therefore effectively a form of lossy compression, can by definition never solve any problem for which the training data or information otherwise available to the system doesn’t already contain the solution.

    We’ve seen new mathematical proofs coming out of LLMs. Those proofs weren’t in the dataset that they were trained on.

    AlphaGo Zero was given the rules of go and made to play against itself with no example games. It came up with new openings that hadn’t been seen before, and were better than anything that humans had come up with.

    AlphaFold was given protein sequences and was able to generate correct 3D structures, that again weren’t in its training data.

    Trying to defend the position of “nothing new comes out of AI” will necessarily lead you to such a narrow definition of novelty, that it will exclude most things that we consider to be human creativity.









  • I typed into Google “potatoes pressure cooker” to get a reminder of how long to cook them. The AI told me, and correctly said that I should use the steamer sieve, but also told me to salt the water. The water that would be under the potatoes and that wouldn’t touch them.

    I asked why, and the AI said that little splashes of salt water from the boiling would land on the surface of the potatoes and salt them gently, that the salt would increase the boiling temperature, and that the vapour would be aromatic.

    I pointed out that the amount of salt landing on the surface of the potatoes would be negligible, that the vapour is distilled water in gas form, and that the increase in boiling temperature from salting the water is less than 1°C. The AI said, oh yeah, you’re right on all counts. Don’t salt the water.

    What it has been doing was exactly what an LLM does. It gave me the received wisdom from the internet.

    That aligns with what Cory Doctorow was saying here, namely that all the AI successes were from people who already knew what they were doing and could use the AI as a tool. Not from people who had no clue and just let AI do the job.