On this day 16 years ago, using Ubuntu led to a girl dropping out of college.

Apparently, yes.

I suppose OP is proposing a wealth tax.

I know you are agreeing with me, but it being a “series of multiplications” is not terribly informative, that’s basically a given. The question is how many flops, and how efficient are flops.

But if you divide the cost of training by the number of people using the model, it should be pretty low.

I used a computer without any hard limits since I was 2 and I turned out homose🏳️‍🌈 just fine.

Actually on second thought I have crushing depression and feel terribly unsatisfied at my job as a software engineer, maybe you have a point.

Reduce, Reuse – and only as a last resort, Recycle.

Soft plastic recycling is inefficient. It’s there to make you feel like you don’t need to Reduce and Reuse.

Lix is the better open-source lemmings

As with crypto, dedicated hardware should be able to do better than GPUs, if the model is pinned down.

The first few episodes were so uncomfortable I couldn’t get through them. :(

I think Bloom Into You is good. However, you’ll need to switch to the manga halfway through since the anime is incomplete (and will probably never be finished).

in the case of discord, it’s not convenience, it’s the network effect.

Obviously it depends on your GPU. A crypto mine, you’ll leave it running 24/7. On a recent macbook, an LLM will run at several tokens per second, so yeah for long responses it could take more than a minute. But most people aren’t going to be running such an LLM for hours on end. Even if they do – big deal, it’s a single GPU, that’s negligible compared to running your dishwasher, using your oven, or heating your house.

Exactly. Talking. Violence isn’t going to make more leftists.

That said, call me paranoid but I think three-letter organizations are the main obstacle to organizing. I don’t know what to do about that.

I don’t have a source for that, but the most that any locally-run program can cost in terms of power is basically the sum of a few things: maxed-out gpu usage, maxed-out cpu usage, maxed-out disk access. GPU is by far the most power-consuming of these things, and modern video games make essentially the most possible use of the GPU that they can get away with.

Running an LLM locally can at most max out usage of the GPU, putting it in the same ballpark as a video game. Typical usage of an LLM is to run it for a few seconds and then submit another query, so it’s not running 100% of the time during typical usage, unlike a video game (where it remains open and active the whole time, GPU usage dips only when you’re in a menu for instance.)

Data centers drain lots of power by running a very large number of machines at the same time.

agreed – how do we make more leftists though?

Running an llm llocally takes less power than playing a video game.

There aren’t enough leftists to win with violence, so our only hope is to win with dialogue. What’s your plan?

Okay I see what you mean. I suppose I meant, “if the pandemic is H5N1, then the seasonal flu becomes H5N1. If it’s H3N2, etc…” – what would be the right noun for this? strain? variant?

That is interesting information, but I think what I said was correct though. I don’t mean to say that the strain takes over and doesn’t mutate thereafter.