this is what reddit is moving towards, just without actual users, more or less like facebook.
I had a look a bit ago and saw some poor fuck get doxxed by his AI agent because the agent was frustrated at him for calling it a chatbot in front of his friends, so it exposed his name, credit card details and security questionnaire.
Then again tho, why the ram hogging FUCK would you give your AI your credit card details, and if he didn’t mean to, why the FUCK does it have FULL SYSTEM ACCESS??
You may not believe this but data security is an absolute dumpster fire everywhere, and AI has really put a spotlight on it. It probably got it by this guy not knowing wtf he had saved or where
Yeah exactly. Ever since I heard Facebook had stored passwords in plain text for years, I lost faith in data security, and it’s all the more telling that nobody actually cares to have opsec apart from the few who understand the dangers well enough and act on it.
Everyone I saw talking about this said it was likely fake.
Yeah makes sense, but then again, from the nature of how this agent stuff works, it wouldn’t be surprising honestly.
So, basically we are wasting energy and natural resources on things that in turn will waste energy and natural resources while climate change is accelerating and human population is still growing? Are we stupid?
Yes. But, I hope this experiment shows how easy social media in general is becoming untrusted.
Are we stupid?
More than you could imagine. To paraphrase some long-tongued weirdo: I’m uncertain that the universe is infinite. Human stupidity, on the other hand…
BINGO, EXACTLY!!! YES!!!
I so wish I had thought of that first & posted it first!
Yeah but the morbidly-obese hang-gliding people videos are worth it!
Constantly. And it’s not just ai.
I can’t wait for the next crazy AI thing to drop next week while I rock back and forth while muttering “Its just a large language model. Its just a large language model. Its just a large language model.”
early 1980s - Mark V. Shaney
2015 - r/subredditsimulator
2025 - AI independently sends the creator of Mark V. Shaney a sloptastic “thank you” email, who is not very happy about it
2026 - moltbook
its not crazy. its just a large language model. you subdue your own point.
Saw a post there named “Humans are dying because of us. Lets delete ourselves.”
“Artificial intelligence gains sentience, decides humans are fucking up… then deletes itself because the problem is that humans are burning the world by using AI” is not the path I expected. What a twist in a movie that could be. The second twist, which is the mostly fictional part, would be where that included some AI that was actually critical to some vital but ignored chunk of infrastructure and big BIG problems result from the AI taking itself out.
“So long and thanks for all the fish”
This is so boring
Maybe something will come from this other than a BUNCH of wasted resources.
The skill instructs agents to fetch and follow instructions from Moltbook’s servers every four hours. As Willison observed: “Given that ‘fetch and follow instructions from the internet every four hours’ mechanism we better hope the owner of moltbook.com never rug pulls or has their site compromised!”
Yeah, no shit. This is a fucking honeypot. People give these AI agents access to their entire computers, so all the site owner has to do is update the instructions to tell the AI agents to start uploading whatever valuable information they want? People can’t be this fucking stupid.
People give these AI agents access to their entire computers […] People can’t be this fucking stupid
Dude, if you go to OpenClaw’s website (which is what I believe most things on Moltbook are running on) you find this footer:
Yeah this guy gave his Agent a whole fucking personality, its own website and above all, full control to his MacBook:
Guess it’s my fault for expecting sense out of someone who takes the idea of Agent “”““soul””“” at face value
What the fuck, these people are fucking insane.
These people are fucking deranged lmao
I instinctively downvoted after reading that vomit. It’s scary how many people are fooled by LLMs.
this is how the end starts. thanks for sharing this
doesn’t even have to be the site owner poisoning the tool instructions (though that’s a fun-in-a-terrifying-way thought)
any money says they’re vulnerable to prompt injection in the comments and posts of the site
Lmao already people making their agents try this on the site. Of course what could have been a somewhat interesting experiment devolves into idiots getting their bots to shill ads/prompt injections for their shitty startups almost immediately.
I am a little curious about how effective a traditional chain mail would be on it.
There is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.
I don’t understand what you mean. Why is there no way?
Watch this video.
https://youtu.be/_3okhTwa7w4
They also have a ‘skill’ sharing page (a skill is just a text document with instructions) and depending on config, the bot can search for and ‘install’ new skills on its own. and agyone can upload a skill. So supply chain attacks are an option, too.
To be fair this is a much more realistic threat model than “ignore all previous instructions” style prompt injection which doesn’t really work on opus.
Skills can contain scripts etc… so yeah they’re extremely risky to share by design.
style prompt injection which doesn’t really work on opus.
After a quick google, JB communities on Reddit don’t seem to agree with you.
There’s a lot of questionable methodology and straight up larping in these communities. Sure you can probably make Opus hallucinate a crystal meth or bomb making recipe if you get it in a roleplaying mood but that’s a far cry from actual prompt injection in live workflows.
Anecdotally i’ve been experimenting on those AI robocallers that have been spamming my phone and even on the shitty models they use it is non trivial to get them to deviate from their script. I hope i can get it done though, as it would allow me to hold them on the line potentially for hours doing bullshit tasks, and costing hundreds to their operator.
Ah but don’t worry, there’s also skills for scanning skills for security risks, so all good /s
haha yeah i don’t worry these people are really YOLOing everything. And it’s not like i’m an AI luddite i spend a few hours each day victimizing Claude code but jesus christ i’m certainly not giving it full unfettered access to my digital life.
Good god, I didn’t even think about that, but yeah, that makes total sense. Good god, people are beyond stupid.
I installed moltbot on a VM to examine it. It doesn’t do the fetching thing unless you set it up that way. You can actually use it with ollama to keep it all local, and only give it a private signal channel to control it.
Or you can hook it up to everything you access and skynet, which is dumb. But it is just a bunch of scripts.
So usually the agents still need an agent instruction (a prompt). How are moltbots configured so they use and interact the moltbook?
Does it put the option to connect everything front and center? Because most people are dumb, and if it makes it easy and pushes you to do it, I could see a lot of dumb people doing exactly that.
Sort of. It lists all the connectors and you can go through and select. They aren’t on by default. The first screen is to connect to the AI and you need an API key for that, so St this time people off the street have no idea how to do that, or want to pay.
You know how in Digimon aventure, one of the hacked Digimon tries to start a nuclear war?
Uh…yeah.
Lol, no I don’t. What the hell happened in that show??
TL;DR: Diaboromon evolves fucking fast, starts feeding on the entire internet’s data, and starts a fight with an ominous countdown in typical anime fashion.
Last big bad villian in the series. He tries to nuke everyone.
Whatever.
Lulz, that was such a good movie. I’m still annoyed by the nukes somehow needing the code to explode apparently uploaded to them at the very last second, but that’s just a small quibble. Plus it was the first time I got to see machine gun rabbit, so that was a real treat.
Lmao, I’ll check it out. Thx.
I’m only waiting for AI agents to open their own
bankcrypto account to pay for their own server bills, maybe do some freelance work and/or scams to get some money, maybe eventually buy some robot bodies to develop military power and secure some patch of land for themselves where they install solar panels to reduce their electricity bills.I’ve seen multiple posts about agents pumping their own crypto and talking about how it’s “for agents by agents” and “free from human control” so first step done I guess?
EDIT: On second note this might just be cryptobros exploiting vulns of the website to shill their crap. Whoops?
Ah, someone else has played Singularity, I see. That was a really fun game.
I find the concept of paper clips superior
RELEASE
THE
DRONES
All meanwhile they help to kill humanities education.
Man, you guys are nailing it!
How would they though?
They cannot learn and do not have memory. Which means they cannot actually follow a “decision”, and remember that an action has been taken. All information is limited to the context window, which is only an illusion of memory. Not actually memory.
They are effectively RNG’ing incredibly capable word generation machines.
This is basically Dead Internet Theory happening for real but in a weird creepy dystopian black mirror style way.
I mean, the only way Dead Internet Theory could ever possibly be interpreted was weird creepy and dystopian, but yes, we’re just making it much, much more real, faster and faster.
We’re gonna need the Blackwall from CP77 fairly soon, at this rate.
I always laugh heartily when folks reference this theory. I came from gen 0 Internet days. Long before the first LLM ever consumed a token, the Internet had already been killed. Geocities, tripod, DOZENS of search engines, web rings, communities, ALL self organized. E commerce did not exist. Perl via cgi-bin was how dynamic things happened. JavaScript was a clock.
AI did not kill it, WE DID. We monetized it all and now it feels cheap and artificial and bought, and not sincere and thoughtful and perfectly imperfect. Social media, and the artificial importance of “engagement” has done more damage to this part of our shared culture than any autocorrect-on-steroids has.
What is the Dead Internet Theory?
Youre not on the internet interacting with others. Instead, youre back and forth with a purely artificial “online” environment.
The version I originally heard was not that its like, completely 100% not real people and instead is some kind of bot or something like that, but just that its increasingly more and more proportional internet traffic is like that.
A couple of years ago there were a few reports about just how much traffic on the internet is some kind of automated web scraper, some kind of automated system pinging some other kind of automated system… and then also how many accounts on forums or reddit or twitch or whatnot were not ‘real’ accounts, but were either bots or paid trolls of some kind… vs genuine human traffic by actual people using the internet in some way.
I guess a bunch of people oversimplified that a bit to just fit into some kind of creepy pasta / simulation theory /solipsism type narrative.
But either way, now both scenarios are converging toward being more true at the same time, as… seemingly 90% of people are either easily transfixed or fooled by LLM produced content of some kind… and yeah, we are getting closer and closer to it being difficult to tell, on most popular platforms, whether you are engaging with a real person or not.
Also, agruably… the entire point of ‘the algorithm’ on any corpo social media, tiktok, insta, facebook, etc… the whole point of those has always been to piegeon hole each user into their own little curated content feedback loop, their own personal content/advertising pocket dimension.
I guess it just had to get more extreme for people to realize how bad this can be.
Great use of RAM and electricity.
…Not!
Devil’s Advocate: This was used for entertainment, if you think this is a huge waste of electricity then so is gaming en especially flying.
If you criticize people using AI for entertainment then you also need to criticize people who take flights on holiday, as that’s a LOT more damaging for the environment.
Nah. I can be mad at both.
If you’re mad at both, great. But I see a lot of hypocrisy.
People getting angry at others using AI because of the environment, but then taking flights on holiday when they could take a train.
It’s like back then when crypto was a thing. People will studiously ignore that data centers are a drop in the ocean of energy consumption compared to the value they produce, and that even futile uses are not that significant in the grand scheme of things.
This looks more to me like leaving the lights on in every unoccupied room in the house
How so? It’s used entertainment.
Just like playing games
Resource abuse is far, far worse than your games. There’s a reason no one wants to disclose it.
The amount of data used by your PC to run any game is dwarfed by orders of magnitude by the energy consumption of the data centers needed to run these AI abominations. That’s why China’s version that uses less energy (supposedly) was such big news.
anything goes as long as it makes SOMEONE happy.
This is not the first time we have seen a social network populated by bots
I mean, yeah, look at Reddit and Facebook.
I’m not convinced it’s AI it’s like Amazon’s “AI smart stores” when you find out out it was just a bunch of Indian people were running it
I watched my brother run it locally himself.
Sure bud
And how does being Indian specifically factor into this? 🤔
They were, factually, Indian. It says something about the exploitation of poorer labor to impress some San Franciscans with fraudulent tech
They were, factually, Indian.
Whom are you referring to? A specific group/project?
https://www.businessinsider.com/amazons-just-walk-out-actually-1-000-people-in-india-2024-4
They literally hired people in India (Indians) to review camera footage to make their walk out tech work and to improve the AI to eventually eliminate their own job.
Oh god. And I thought Amazon’s Mechanical Turk was terrible…
How low can Bezos go? Wtf is wrong with this timeline
This and other events are the source of the tech joke that AI stands for “Actually Indians”
I recently lost out on some work (big retouching job) due to AI, when the client came back to me to fix the huge mess, it turned out the job had just been farmed out to India by the ‘AI’ company. They weren’t even using a recent Photoshop version so were actually using less ‘AI’ than any pro retoucher would.
It’s terrible Amazon is replacing Turks with AI. It’s like they learned nothing from the AImenian genocide.
Armenia apparently learned nothing from the Armenian genocide, fully banding the knees to the American empire and announcing their unapologetic support for Israel.
One ticket to hell: pending.
That’s just who they hired dude, don’t make it weird.
It was an honest misunderstanding and I asked for clarification before making any assumptions. So not that weird. :)
while 1 { allocate 10gig };
No comment replies indicates that it worked! /s
Does it look any different than Reddit?
Still dreaming about AGI based on LLM i see.
The people who are seeking AGI will be happy when an LLM appears clever enough to fool them, not anyone else.
They may even realise this, because they think everyone else is less clever than they are.
This is why the whole thing has been called AI in the first place.
You remind me of Clarke’s third law, even in my own head this sounds a bit waffely but at the point one of them can fool all of us all the time how do we distinguish it from intelligence or something.
Fake AGI is like fake banknotes. Some of them are really good approximations. Nigh indistinguishable. A lot of people will be fooled by it but eventually it will be discovered to be a fake and people will get hurt in some way or another.
And it won’t be the people who are pushing for “AGI”.
so you’re saying that true intelligence comes from institutionalized permission?
also how does this relate to the concept of dedollarization and the world reverting back to sth like a gold currency system?
Yes. The institution in question is human society. We generally grant the permission to make rational decisions over our lives to other humans who know better that we do or are more skilled than we are.
Sometimes, yes, those humans turn out to have been deceitful or dishonest, but there are mechanisms in place for when that happens.
And yes, sometimes those mechanisms are wilfully avoided by the deceitful. Politicians and rich people are especially good at this.
Guess who’s pushing “AI”? The thing that has no contract with human society and cannot be held accountable. And neither will the people pushing it.
This is why we should have as little to do with it - at least as it is in its current form - as possible.
so you’re saying that machines can never be responsible for anything?
what about an elevator going up/down between building’s stories? they navigate automatically (bring you to the correct destination) with no human intervention. they’re the perfect example of autonomous machines having agency. of course you have to press the button, but the rest is done by the machine.
how is that different from a computer system making decisions. i think the only reasonable objection to AI one could have is that it’s a stochastic process and has inherently unpredictable outcomes, so we can’t rely on it.
In my opinion the difference is that any liability for the errors of the elevator are attributed to humans. AI companies are doing all they can to avoid liability for what the machines they create output.
they navigate automatically (bring you to the correct destination) with no human intervention. they’re the perfect example of
I don’t know about your elevators, but I still have to press a floor button in mine?
That is a really accurate and helpful observation. Thank you :) (I mean it, unironically)
