CEO of cloudflare says he’ll donate the bandwidth for Wordpress dot org to shut mullenweg up https://xcancel.com/eastdakota/status/1841154152006627663
TechTakes
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
Cloudflare is such a weird company in various ways. Saying loudly that they can't judge groups when people ask them not to support the neo-nazis, harassers and worse (they have moved on this under pressure, but it takes a lot of pressure). But then they do this.
I might be wrong but this sounds like a quick way to make the web worse by putting a huge computational load on your machine for the purpose of privacy inside customer service chat bots that nobody wants. Please correct me if I’m wrong
WebLLM is a high-performance in-browser LLM inference engine that brings language model inference directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU.
WebLLM is fully compatible with OpenAI API. That is, you can use the same OpenAI API on any open source models locally, with functionalities including streaming, JSON-mode, function-calling (WIP), etc.
We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.
I do believe that’s the chrome-only horseshit that Proton uses for their local LLM, and reputedly it’s very slow and fairly unreliable
I read this twice as LLM interference engine and was hoping for something like SETI or Folding@Home except my computer could interfere with ChatGPT somehow.
In the endless genAI shit that the bird site pushes on me, this caught my eye because it seems like a dream tool for a non-tech suit to generate blame examples for engineers https://xcancel.com/rohanpaul_ai/status/1840941643223945561
what's the over/under on the spruce pine thing causing promptfondlers and their ilk to suddenly not be able to get chips, and then hit a(n even more concrete) ceiling?
(I know there may be some of the stuff in stockpiles awaiting fabrication, but still, can't be enough to withstand that shock)
If we're lucky, it'll cut off promptfondlers' supply of silicon and help bring this entire bubble crashing down.
It'll probably also cause major shockwaves for the tech industry at large, but by this point I hold nothing but unfiltered hate for everyone and everything in Silicon Valley, so fuck them.
Building 5-7 5GW facilities full of GPUs is going to be an extremely large amount of silicon. Not to mention the 25-35 nuclear power plants they apparently want to build to power them.
So on the list of things not happening...
that would be 25-35 reactors, as long as cooling is available you can just put them in one place. 5GW is around size of largest european nuclear powerplants (Zaporozhian, 5.7GW; Gravelines, 5.4GW; six blocks each) or around energy consumption of decently-sized euro country like Ireland, Hungary or Bulgaria. 25GW is electricity consumption of Poland, 30GW UK, 35GW Spain
this is not happening hardest because by the time they'd get permits for NPP they'll get bankrupt because bubble will be over
(Another post so soon? Another post so soon.)
"Gen AI competes with its training data, exhibit 1,764":
Also got a quick sidenote, which spawned from seeing this:
This is pure gut feeling, but I suspect that "AI training" has become synonymous with "art theft/copyright infringement" in the public consciousness.
Between AI bros publicly scraping against people's wishes (Exhibit A, Exhibit B, Exhibit C), the large-scale theft of data which went to produce these LLMs' datasets, and the general perception that working in AI means you support theft (Exhibit A, Exhibit B), I wouldn't blame Joe Public for treating AI as inherently infringing.
r/SubredditDrama's watching shit go down in r/EffectiveAltruism, and there's a lotta sneers going on
It is worth mentioning that this is the question that catalysed the SRD post:
Most Effective Aid to Gaza?