could be advancements like this that now make it possible https://interestingengineering.com/energy/china-achieves-fusion-milestone-neural-networks

exactly

some recent games I absolutely loved

• Disco Elysium
• Children of Morta
• Viewfinder
• Planet of Lana
• INSIDE
• Limbo
• Chained Echoes
• Detroit: Become Human
• Triangle Strategy
• Tunic
• Prodeus

I’m saying that the medium of text is not a good way to create a world model, and the problems LLMs have stem directly from people trying to do that. Just because autocomplete produces results that look fancy doesn’t make it actually meaningful. These things are great for scenarios where you just want to produce something aesthetically pleasing like an image or generate some text. However, this quickly falls apart when it comes to problems where there is a specific correct answer.

Furthermore, there is plenty of progress being made with DNNs and CNNs using embodiment which looks to be far more promising than LLMs in actually producing machines that can interact with the world meaningfully. This idea that GPT is some holy grail of AI seems rather misguided to me. It’s a useful tool, but there are plenty of other approaches being explored, and it’s most likely that future systems will use a combination of these techniques.

Diaspora by Greg Egan, it’s one of the best thought out take on what a post human society could look like. Lots of amazing ideas in the book.

Actually we do know that there are diminishing returns from scaling already. Furthermore, I would argue that there are inherent limits in simply using correlations in text as the basis for the model. Human reasoning isn’t primarily based on language, we create an internal model of the world that acts as a shared context. The language is rooted in that model and that’s what allows us to communicate effectively and understand the actual meaning behind words. Skipping that step leads to the problems we’re seeing with LLMs.

That said, I agree they are a tool, and they obviously have uses. I just think that they’re going to be a part of a bigger tool set going forward. Right now there’s an incredible amount of hype associated with LLMs. Once the hype settles we’ll know what use cases are most appropriate for them.

Right, I find LLMs are fundamentally no different from Markov chains. It doesn’t mean they’re not useful, they’re a tool that’s good for certain use cases. Unfortunately, we’re in a hype phase right now where people are trying to apply them for a lot of cases they’re terrible at and where better tools already exist to boot.

Should the research he’s discussing also be disregarded? https://arxiv.org/pdf/2410.05229

Indeed, I find qunata magazine have some of the best science reporting.

colonizer

fully automated luxury communism on the way :)

Saying something can be proven in principle isn’t very useful in practical terms. The fact of the matter is that the real world is simply too complex for the human mind to fully understand from first principles. Science is fundamentally about creating models of the world that are useful approximations of reality, it’s not a black and white thing. Asimov explains this well here https://mvellend.recherche.usherbrooke.ca/Asimov_anglosaboteurs.pdf

The link I used clearly shows what people mean by the western world, the fact that it doesn’t include Japan or Korea isn’t the own that you seem to think it is. Of course, I never expect any sort of intelligent response here. lol indeed

What part of the government is making information illegal are you struggling comprehend? If there was some magical anti-censorship platform that was usable by regular people then it would just be banned, and then people using it would be arrested. This is not a technology problem.

It’s incredible that it needs to be explained that the issue is with the censorship regardless of what particular service is being censored or what you personally happen to think of it.

🤡 https://en.wikipedia.org/wiki/Western_world

Yes, it’s literally occupied by the US military.

No, anything that’s a vassal state of the US is the west. And yes, Japan and Australia are understood to be part of the western bloc. This isn’t even controversial.

Yeah, Samsung is located in the occupied Korea which is part of the empire last I checked.

continuing to miss the point I see