this post was submitted on 30 Sep 2024
40 points (100.0% liked)

TechTakes

1425 readers
290 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
 

Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

Last week's thread

(Semi-obligatory thanks to @dgerard for starting this)

(page 2) 50 comments
sorted by: hot top controversial new old
[–] [email protected] 9 points 1 month ago (1 children)

CEO of cloudflare says he’ll donate the bandwidth for Wordpress dot org to shut mullenweg up https://xcancel.com/eastdakota/status/1841154152006627663

[–] [email protected] 8 points 1 month ago (7 children)

Cloudflare is such a weird company in various ways. Saying loudly that they can't judge groups when people ask them not to support the neo-nazis, harassers and worse (they have moved on this under pressure, but it takes a lot of pressure). But then they do this.

load more comments (7 replies)
[–] [email protected] 9 points 1 month ago* (last edited 1 month ago) (2 children)

I might be wrong but this sounds like a quick way to make the web worse by putting a huge computational load on your machine for the purpose of privacy inside customer service chat bots that nobody wants. Please correct me if I’m wrong

WebLLM is a high-performance in-browser LLM inference engine that brings language model inference directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU.

WebLLM is fully compatible with OpenAI API. That is, you can use the same OpenAI API on any open source models locally, with functionalities including streaming, JSON-mode, function-calling (WIP), etc.

We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.

https://github.com/mlc-ai/web-llm

[–] [email protected] 8 points 1 month ago (7 children)

I do believe that’s the chrome-only horseshit that Proton uses for their local LLM, and reputedly it’s very slow and fairly unreliable

load more comments (7 replies)
[–] [email protected] 8 points 1 month ago

I read this twice as LLM interference engine and was hoping for something like SETI or Folding@Home except my computer could interfere with ChatGPT somehow.

[–] [email protected] 9 points 1 month ago (11 children)

In the endless genAI shit that the bird site pushes on me, this caught my eye because it seems like a dream tool for a non-tech suit to generate blame examples for engineers https://xcancel.com/rohanpaul_ai/status/1840941643223945561

load more comments (11 replies)
[–] [email protected] 9 points 1 month ago (2 children)

what's the over/under on the spruce pine thing causing promptfondlers and their ilk to suddenly not be able to get chips, and then hit a(n even more concrete) ceiling?

(I know there may be some of the stuff in stockpiles awaiting fabrication, but still, can't be enough to withstand that shock)

[–] [email protected] 9 points 1 month ago

If we're lucky, it'll cut off promptfondlers' supply of silicon and help bring this entire bubble crashing down.

It'll probably also cause major shockwaves for the tech industry at large, but by this point I hold nothing but unfiltered hate for everyone and everything in Silicon Valley, so fuck them.

[–] [email protected] 8 points 1 month ago (1 children)

Building 5-7 5GW facilities full of GPUs is going to be an extremely large amount of silicon. Not to mention the 25-35 nuclear power plants they apparently want to build to power them.
So on the list of things not happening...

[–] [email protected] 8 points 1 month ago (3 children)

that would be 25-35 reactors, as long as cooling is available you can just put them in one place. 5GW is around size of largest european nuclear powerplants (Zaporozhian, 5.7GW; Gravelines, 5.4GW; six blocks each) or around energy consumption of decently-sized euro country like Ireland, Hungary or Bulgaria. 25GW is electricity consumption of Poland, 30GW UK, 35GW Spain

this is not happening hardest because by the time they'd get permits for NPP they'll get bankrupt because bubble will be over

load more comments (3 replies)
[–] [email protected] 9 points 1 month ago (19 children)

(Another post so soon? Another post so soon.)

"Gen AI competes with its training data, exhibit 1,764":

exhibit 1764

Also got a quick sidenote, which spawned from seeing this:

This is pure gut feeling, but I suspect that "AI training" has become synonymous with "art theft/copyright infringement" in the public consciousness.

Between AI bros publicly scraping against people's wishes (Exhibit A, Exhibit B, Exhibit C), the large-scale theft of data which went to produce these LLMs' datasets, and the general perception that working in AI means you support theft (Exhibit A, Exhibit B), I wouldn't blame Joe Public for treating AI as inherently infringing.

load more comments (19 replies)
[–] [email protected] 9 points 1 month ago* (last edited 1 month ago) (2 children)
[–] [email protected] 8 points 1 month ago* (last edited 1 month ago)

It is worth mentioning that this is the question that catalysed the SRD post:

Most Effective Aid to Gaza?

load more comments (1 replies)
load more comments
view more: ‹ prev next ›