As long as the AI is capable enough, I don't see what's wrong with it, and I understand if Reddit decides to utilize AI for financial reasons. Though I don't know how capable the AI is, and it is certainly not perfect, but AI is a technology and it will improve over time. If a job can be automated, I don't see why it should not be automated.
AI is often only trained on neurotypical cishet white men. What happens when a community of colour is full of people who don't have the same conversational norms as white people, and the bot thinks they're harassing each other? What happens when a neurodivergent community talk to each other in a neurodivergent way? Autistic people often get called "robotic", will the AI feel the same way and ban them as bots? What happens when an AI is used to moderate a trans community, and flags everything as NSFW because its training data says "transgender" is a porn category?
I think it's a bold assumption to think that AI is often only trained by neurotypical cishet white men, though it is a possibility. I do not fully understand how AI works and how the company trains their AI so I cannot comment any further. I admit AI has its downsides, but AI also has its upsides, same as humans. Reddit is free to utilize AI to moderate subreddits, and users are free to complain or leave reddit if they deem that their AI is more harmful than helpful.
If your personality makes you sound like a bot, then you're exactly the kind of person I'm talking about when I say that AI is going to ban real people for being spambots. I think you sound like a bot, and so will AI. I am capable of critical thinking and looking past first impressions, an AI is not.
I think maybe you're under the impression that computers run on perfect logic. Machine learning systems actually run on pure instinct. You are more capable of logical reasoning than an ML program is. You're less capable than a traditional algorithmic program, but you're more capable than an AI.
I admit I might be biased towards AI because I believe AI isn't biased because it doesn't have any desire, to sleep, breath, eat, etc. Everyone is capable of critical thinking, the question is, is it good or not? And since AI is trained by humans and humans have critical thinking, I don't see why AI cannot develop one, although it may not be as good as some people.
All AI has to be biased, that bias is the training data and (inherently biased) humans select the training set. Funnily enough, the weights on each node of a neutral net are even sometimes called biases!
If any AI wasn't biased it would simply produce unintelligible garbage.
I'm a computer scientist, and I will tell you right now that AI is biased. Here's how you train a neural network AI: you arrange a whole lot of neurons, you reinforce the connections between the neurons when it succeeds, and you weaken the connections when it fails. That's the same way your brain works. When you eat food or have sex or do something else beneficial to survival, your neural connections are strengthened. An ANN AI is driven by its training directive just like you're driven to eat or have sex. It develops the same biases.
And since AI is trained by humans and humans have critical thinking, I don't see why AI cannot develop one
This is nonsense. Humans invented the horse drawn wagon. Is a wagon ever going to develop critical thinking? No. AI isn't a child with boundless potential, it's a tool, just like a wagon. If humans want AI to have critical thinking, they're going to have to build it. And no human has ever succeeded at that yet. The AI that Reddit is using does not have it. And since the AI is a profitable tool in its current state, it will probably not be improved to the level of a human.
That's not AI works. It's exactly as biased as the humans who produced the content on which it is trained.
That said, I also don't believe these models have been trained exclusively on white straight men's conversations, that would take some effort to achieve.
More likely, it's been trained on internet forums, so similar to what it's being asked to moderate. And as long as there's a human at the other end of an appeal, it should be fine.
AI is often only trained on neurotypical cishet white men.
Can you back up this claim? Unless you're just being an assumer, or you expect people to be suckers/gullible/"chrust" you.
What happens when a community of colour is full of people who don’t have the same conversational norms as white people
In this statement alone, there are not one but two instances of a racist discourse:
Conflating culture (conversational norms) with race.
Singling out "white people", but lumping together the others under the same label ("people of colour").
You are being racist. What you're saying there boils down to "those brown people act in weird ways because they're brown". Don't.
What happens when a neurodivergent community talk to each other in a neurodivergent way? Autistic people often get called “robotic”, will the AI feel the same way and ban them as bots?
The reason why autists are often called "robotic" has to do with voice prosody. It does not apply to text.
And the very claim that you're making - that autists would write in a way that an "AI" would confuse them with bots - sounds, frankly, dehumanising and insulting towards them. And reinforcing the stereotype that they're robotic.
[From another comment] Did you write your comment with chatgpt?
Passive aggressively attacking the other poster won't help.
Odds are that you're full of good intentions writing the above, but frankly? Go pave hell back in Reddit, you're being racist and dehumanising.
The model-based decision making is likely not capable enough. Specially not for the way that Reddit Inc. would likely use it - leaving it in charge of removing users and content assumed to be problematic, instead of flagging them for manual review.
I'm specially sceptic on the claim in the site that their Hive Moderation has "human-level accuracy". Specially over time - as people are damn smart when it comes to circumventing automated moderation. Also let us not forget that the human accuracy varies quite a bit, and you definitively don't want average accuracy, you want good accuracy.
As long as the AI is capable enough, I don't see what's wrong with it, and I understand if Reddit decides to utilize AI for financial reasons. Though I don't know how capable the AI is, and it is certainly not perfect, but AI is a technology and it will improve over time. If a job can be automated, I don't see why it should not be automated.
AI is often only trained on neurotypical cishet white men. What happens when a community of colour is full of people who don't have the same conversational norms as white people, and the bot thinks they're harassing each other? What happens when a neurodivergent community talk to each other in a neurodivergent way? Autistic people often get called "robotic", will the AI feel the same way and ban them as bots? What happens when an AI is used to moderate a trans community, and flags everything as NSFW because its training data says "transgender" is a porn category?
I think it's a bold assumption to think that AI is often only trained by neurotypical cishet white men, though it is a possibility. I do not fully understand how AI works and how the company trains their AI so I cannot comment any further. I admit AI has its downsides, but AI also has its upsides, same as humans. Reddit is free to utilize AI to moderate subreddits, and users are free to complain or leave reddit if they deem that their AI is more harmful than helpful.
Did you write your comment with chatgpt?
Nope, just my personality. I think i have grammar mistakes too.
If your personality makes you sound like a bot, then you're exactly the kind of person I'm talking about when I say that AI is going to ban real people for being spambots. I think you sound like a bot, and so will AI. I am capable of critical thinking and looking past first impressions, an AI is not.
I think maybe you're under the impression that computers run on perfect logic. Machine learning systems actually run on pure instinct. You are more capable of logical reasoning than an ML program is. You're less capable than a traditional algorithmic program, but you're more capable than an AI.
I admit I might be biased towards AI because I believe AI isn't biased because it doesn't have any desire, to sleep, breath, eat, etc. Everyone is capable of critical thinking, the question is, is it good or not? And since AI is trained by humans and humans have critical thinking, I don't see why AI cannot develop one, although it may not be as good as some people.
All AI has to be biased, that bias is the training data and (inherently biased) humans select the training set. Funnily enough, the weights on each node of a neutral net are even sometimes called biases!
If any AI wasn't biased it would simply produce unintelligible garbage.
https://time.com/5520558/artificial-intelligence-racial-gender-bias/
I'm a computer scientist, and I will tell you right now that AI is biased. Here's how you train a neural network AI: you arrange a whole lot of neurons, you reinforce the connections between the neurons when it succeeds, and you weaken the connections when it fails. That's the same way your brain works. When you eat food or have sex or do something else beneficial to survival, your neural connections are strengthened. An ANN AI is driven by its training directive just like you're driven to eat or have sex. It develops the same biases.
This is nonsense. Humans invented the horse drawn wagon. Is a wagon ever going to develop critical thinking? No. AI isn't a child with boundless potential, it's a tool, just like a wagon. If humans want AI to have critical thinking, they're going to have to build it. And no human has ever succeeded at that yet. The AI that Reddit is using does not have it. And since the AI is a profitable tool in its current state, it will probably not be improved to the level of a human.
That's not AI works. It's exactly as biased as the humans who produced the content on which it is trained.
That said, I also don't believe these models have been trained exclusively on white straight men's conversations, that would take some effort to achieve.
More likely, it's been trained on internet forums, so similar to what it's being asked to moderate. And as long as there's a human at the other end of an appeal, it should be fine.
Just checked this with an AI detector and it said human. Bot 1, human 0. This sentance kinda undermined your point for keeping humans only.
Can you back up this claim? Unless you're just being an assumer, or you expect people to be suckers/gullible/"chrust" you.
In this statement alone, there are not one but two instances of a racist discourse:
You are being racist. What you're saying there boils down to "those brown people act in weird ways because they're brown". Don't.
The reason why autists are often called "robotic" has to do with voice prosody. It does not apply to text.
And the very claim that you're making - that autists would write in a way that an "AI" would confuse them with bots - sounds, frankly, dehumanising and insulting towards them. And reinforcing the stereotype that they're robotic.
Passive aggressively attacking the other poster won't help.
Odds are that you're full of good intentions writing the above, but frankly? Go pave hell back in Reddit, you're being racist and dehumanising.
The model-based decision making is likely not capable enough. Specially not for the way that Reddit Inc. would likely use it - leaving it in charge of removing users and content assumed to be problematic, instead of flagging them for manual review.
I'm specially sceptic on the claim in the site that their Hive Moderation has "human-level accuracy". Specially over time - as people are damn smart when it comes to circumventing automated moderation. Also let us not forget that the human accuracy varies quite a bit, and you definitively don't want average accuracy, you want good accuracy.
Regarding the talk about biases, from another comment: models are prone to amplify biases, not just reproduce them. As such the model doesn't even need to be trained only in a certain cohort to be biased.