something that happened two years ago

Looks like this change happened between Jan 19 and Jan 20 2025 - less than a year ago.

Stop panicking, people. It’s silly.

I don’t think anyone is panicking. If anything I reckon most people find it hilarious 😂 microslop are desperate to make some money with their LLMs and it’s funny that noone is interested.

deleted by creator

Just to point out that per the discussion in the screenshot: Synthetic datasets are typically generated from models that were trained by poverty-pay Kenyans. This is basically ethics-washing.

years or decades.

Let’s face it, in neoliberal democracies we barely think past the next quarter. Next election cycle at the most!

I would love a government with a long term outlook rather than one that is concerned only with getting re-elected or failing that getting a cushy job with one of their “donors” after they leave office

Well Anthropic chose to settle their piracy lawsuit out of court which probably indicates that they thought there was a reasonable chance they could have lost the case. No legally binding precedents set yet though afaik.

She lost that some time in August 2022 I think. Put it in a “safe place”

Yeah I agree. Small models is the way. You can also use LoRa/QLoRa adapters to “fine tune” the same big model for specific tasks and swap the use case in realtime. This is what apple do with apple intelligence. You can outperform a big general LLM with an SLM if you have a nice specific use case and some data (which you can synthesise in come cases)

Unlike the dotcom bubble, Another big aspect of it is the unit cost to run the models.

Traditional web applications scale really well. The incremental cost of adding a new user to your app is basically nothing. Fractions of a cent. With LLMs, scaling is linear. Each machine can only handle a few hundred users and they’re expensive to run:

Big beefy GPUs are required for inference as well as training and they require a large amount of VRAM. Your typical home gaming GPU might have 16gb vram, 32 if you go high end and spend $2500 on it (just the GPU, not the whole pc). Frontier models need like 128gb VRAM to run and GPUs manufactured for data centre use cost a lot more. A state of the art Nvidia h200 costs $32k. The servers that can host one of these big frontier models cost, at best, $20 an hour to run and can only handle a handful of user requests so you need to scale linearly as your subscriber count increases. If you’re charging $20 a month for access to your model, you are burning a user’s monthly subscription every hour for each of these monster servers you have turned on. That’s generous and assumes they’re not paying the “on-demand” price of $60/hr.

Sam Altman famously said OpenAI are losing money on their $200/mo subscriptions.

If/when there is a market correction, a huge factor of the amount of continued interest (like with the internet after dotcom) is whether the quality of output from these models reflects the true, unsubsidized price of running them. I do think local models powered by things like llamacpp and ollama and which can run on high end gaming rigs and macbooks might be a possible direction for these models. Currently though you can’t get the same quality as state-of-the-art models from these small, local LLMs.

Relative privation is when someone dismisses or minimizes a problem simply because worse problems exist: “You can’t complain about X when Y exists.”

I’m talking about the practical reality that you must prioritize among legitimate problems. If you’re marooned at sea in a sinking ship you need to repair the hull before you try to fix the engines in order to get home.

It’s perfectly valid to say “I can’t focus on everything so I will focus on the things that provide the biggest and most tangible improvement to my situation first”. It’s fallacious to say “Because worse things exist, AGI concerns doesn’t matter.”

Here’s how I see it: we live in an attention economy where every initiative with a slew of celebrities attached to it is competing for eyeballs and buy in. It adds to information fatigue and analysis paralysis . In a very real sense if we are debating AGI we are not debating the other stuff. There are only so many hours in a day.

If you take the position that AGI is basically not possible or at least many decades away (I have a background in NLP/AI/LLMs and I take this view - not that it’s relevant in the broader context of my comment) then it makes sense to tell people to focus on solving more pressing issues e.g. nascent fascism, climate collapse, late stage capitalism etc.

The telegraph is a low-quality right-wing rag in the UK that frames everything with a hint of xenophobia. I’d say it’s a pretty poor source for “world news”. Definitely take it with a large dose of salt.

Edit: MBFC rating is “mixed” with right-wing bias

If we get a breakthrough moment with quantum, the machines will not be evenly distributed to start with. They will be too expensive to build, power and cool unless you’re a fortune 500 exactly like LLMs right now (aside from small models like llama that can run on consumer hardware). At the moment quantum computers rely on superconductors that have to be cooled near absolute zero which is… somewhat expensive to achieve.

Unlike LLMs (oh no I can’t talk to waifu without cell coverage waah) Not being able to run quantum algorithms on your phone in this scenario would be bad. It either means your personal comms are, for all intents and purposes decryptable by those who control the quantum machines or that you’ll have to pay rent to the people who control quantum machines to have them encrypt and decrypt stuff for you. Of course you’ll have to trust them too. Also, given governments thirst for spying on our encrypted comms, it’s possible that quantum machines are heavily regulated allowing “the good guys” a back door into our chats without giving “the baddies” a way to encrypt their comms

Everyone knows Franz Ferdinand, the indie rock band from Glasgow. Their 2004 hit “take me out” is definitely historical /s

Presumably it’s selling snake oil and convincing people to trust them?

Stupid sexy pipes

In the United Kingdom yes because of our authoritarian Online Safety Act that came into power earlier this year. If I join a discord channel marked as nsfw I get a prompt for id which I bypass with a VPN in another country.

Same take my friend. I agree - Tim’s personal politics are kinda irrelevant in this context. Best for apple=compliance with whoever is in charge so they get to keep their money printer. Corpos gonna corpo

You’re giving apple too much credit. Tim Apple literally gifted trump a golden statue. The press are reporting that this is directly in response to a request from the DOJ. This isn’t apple having a moral epiphany and thinking they’re doing ice targets a favour. Corporations don’t do that sort of thing unless it will make them $$$

My Gmail account is old enough to buy drinks in a bar in the US (21)

It’s easy to make this kind of generalisation but in reality we are like any other western country - extremely polarised by social and traditional media and currently vearing towards fascism because of a combination of external manipulation and increasing inequality and misplaced anger about it.

Our population is also quite stratified in terms of race - there are some very multi-cultural cities and towns and there are towns where the population is entirely white and the locals only experience of other cultures is via the TV or speciality restaurants and shops in the next town over (source: grew up in one such place. Remember having conversation with a guy who said “tried an Indian, it was quite nice actually!”). I suppose this is comparable to the US Western and Eastern seaboards Vs “small town America”. People who have never met anyone with a different skin pigment are much easier to manipulate into thinking that all different people are here to take our jobs and live off welfare provided by our hard work. Those people are strongly influenced by the right-wing press such as the daily mail who supported the Nazis the last time around too. (Sidenote: that paper’s ownership remains with the same family. Never ever open their site and give them ad revenue).

In reality, many cities are multi-cultural, diverse and open these days. The white fash-inclined people are worried that this open and diverse culture might spread to their town. Partly because the political class, backed up by the DM and GBNews and even the ‘impartial’ BBC tell them to be.

I’d highly recommend watching Adam Curtis’ recent documentary series “Shifty” which follows the downfall of Britain’s industrial base and disenfranchisement of the working class led by Thatcher and Blair during the 80s and 90s. It is eye opening.

The Labour party is supposed to be our centre-left party but they are copying the US-Dems in trying to appeal to the right who will never vote for them and alienating their base. They ousted their left-wing leader about 8 years ago and installed Starmer who is for sure a plant for the landed gentry/corporate interests.

TL;DR not all of us are fash inclined, not even most of us. If you’re reading this and you’re new to this country, seek us out and don’t lose heart.