Zos_Kia

I don’t remember people being offended by the word fuck in 2000. Sure on TV it could be considered dicey but on the internet it was pretty fair game

dear diary today on Lemmy i saw a guy who was angry at a job title

I’m not sure what you mean. Integrating LLMs in a codebase requires the use of specific tools. Sure it’s not as established and wide ranging as “frontend” but it’s still something that you need to learn and work on if you want to do it well. Kind of like, you know, a skill.

yeah and we all know there is only the one type of software engineer. It would be ridiculous to separate them into categories depending on whether they work on frontend, backend, embedded lmao

I … I don’t know man !

I think some time around the year 10000 humanity solved most of their problem and the only remaining scarcity was “good living”. Like, cultures that had a sophisticated way of enjoying life through good food, good drink and good companionship suddenly came at a high premium. The people from SW France became insanely wealthy very quick, and a sort of federation was struck between the Gascony people, the Basque and the Brittons. It was really the only possible counter-power to the more colonialist and military minded Italians.

Boar religion could be described as Albigensian catharism, except in space. Their freedom-loving ways are despised by the Italian catholic church but the galaxy is so vast that religion wars never really break out, it’s just local skirmishes.

I haven’t yet determined what animal the italians have morphed into, really glad to hear any suggestion.

Oh and here’s a picture of the Assembly of the Perfecti, held annually at Baiona Station :

I think they have adapted to life in hard vacuum they just wear those helmet cause they look pretty

Since Gen art became a thing i’ve been using it episodically to create images of a civilization of space-faring boars, representing the future of my glorious South-Western France civilization. They raise ducks and grow wine in space, and the lore is getting a lot deeper than i first thought. It’s so fucking fun man.

If there’s one thing artists don’t do, it’s try and build a picket fence around Art to separate it from Not Art. Duchamp was 100 years ago i think the point that “Art can be anything and everything” has been abundantly made during the 20th century.

Remember when corporations tried to claim that money you didn’t spend on their product was theft ? This way of thinking has been recycled by the anti-AI bros.

Turns out all the money you don’t spend on struggling artists is not only theft, but also class warfare. You stinking bougie you.

Except it’s not used as a job title to describe people prompting Midjourney lol. A prompt engineer is a software engineer who specifically deals with LLM workflows.

If I understand these things correctly, the context window only affects how much text the model can “keep in mind” at any one time. It should not affect task performance outside of this factor.

Yeh, i did some looking up in the meantime and indeed you’re gonna have a context size issue. That’s why it’s only summarizing the last few thousand characters of the text, that’s the size of its attention.

There are some models fine-tuned to 8K tokens context window, some even to 16K like this Mistral brew. If you have a GPU with 8G of VRAM you should be able to run it, using one of the quantized versions (Q4 or Q5 should be fine). Summarizing should still be reasonably good.

If 16k isn’t enough for you then that’s probably not something you can perform locally. However you can still run a larger model privately in the cloud. Hugging face for example allows you to rent GPUs by the minute and run inference on them, it should just net you a few dollars. As far as i know this approach should still be compatible with Open WebUI.

There are not that many use cases where fine tuning a local model will yield significantly better task performance.

My advice would be to choose a model with a large context window and just throw in the prompt the whole text you want summarized (which is basically what a rag would do anyway).

Ok that one is hilarious

Le ai Bad amirite guize

If you like to write, I find that story boarding with stable diffusion is definitely an improvement. The quality of the images is what it is, but they can help you map out scenes and locations, and spot visual details and cues to include in your writing.

Jesus Christ man 😂 you’re looking for a moral angle but there is no moral angle here. A business has the right to design their transactions however they want, even if that design explicitly excludes people like you.

Some people are easy-going, they are more prone to trust, they want to test a product they don’t write an essay about it about it they just put their CC info in, try the thing, and cancel the sub if it’s not for them. If they forget to cancel i refund their money cause i need a happy customer more than i need 20 bucks. You don’t need to call them rubes just because they’re invited to the party and you’re not.

Hey man I’m not saying you’re wrong, but you’re touching on another important thing which is trust. On average, high trust people are just easier to manage, especially when you’re a small outfit. It’s better for everyone if low trust users bounce away because of the cc wall. They’ll come back once the product has some brand recognition or social proof.

Again, it’s a filter. You give me card details, that means you seriously want the product and also that you trust me. If i treat you right and give you a great experience you’ll be subscribed for years, purchasing add-ons, and recommending me to your friends. That’s much more valuable for me than skimming 20 bucks a month because you forgot to unsub.

When it’s a big corpo sure they’ll do it cause they don’t give a shit about their customers or even their reputation. I’m honestly not saying it doesn’t happen. But when it’s a no-name with a small online product they can’t afford that shit. If they put a credit card wall it’s most likely because they were getting too many people on the free trial, and were having a hard time telling actual future customers from drive-bys. This solves that.

lmao what a nuanced point of view, you seem to have vast personal experience of this kind of things