morrowind

Was working fine this morning for me. No updates.

But now it keeps crashing and my phone shows popups saying "something went wrong with summit". Clearing the cache and force killing the app didn't help

discord is a black hole for information

Traditional reasoning says you should prefer open forums like lemmy that are available and searchable to the open web. After all, you're posting to help people, and that helps people the most. The platform (like reddit) may profit off of it, but that's fine, they're providing the platform for you to post. Fair deal.

Plus people coming for high quality information helps the community and topic back. You attract other high quality contributors, the more people use/partake in the topic you are discussing, the platform often improves with the revenue etc. It's not perfect, but it worked

AI scrapers break all that. The company profiting is the AI company, and they give nothing back. They model just holds all the information in its weights. It doesn't drive people to the source. Even the platform doesn't benefit from bot scraping. The addition of high quality data may improve the model on that topic and thus push people to engage in said topic more, but not much, because of how AI's are trained, while you need some high quality data, a lot more important, especially for lesser known topics, is amount of data.

So as more of the world moves to AI models, I don't really feel like posting on public forums as much, helping the AI companies get richer, even if I do benefit from AI myself.

Other platforms too, but I'm on lemmy. I'm mainly talking about LLMs in this post

First, let me acknowledge that AI is not perfect, it has limitations e.g

• tendency to hallucinate responses instead of refusing/saying it doesn't know
• different models/models sizes with varying capabilities
• lack of knowledge of recent topics without explicitly searching it
• tendency to be patternistic/repetitive
• inability to hold on to too much context at a time etc.

The following are also true:

• People often overhype LLMs without understanding their limitations
• Many of those people are those with money
• The term "AI" has been used to label everything under the sun that contains an algorithm of some sort
• Banana poopy banana (just to make sure ppl are reading this)
• There have been a number companies that overpromised for AI, and often were using humans as a "temporary" solution until they figured out the AI, which they never did (hence the gag, "AI" stands for "An Indian")

But I really don't think they're nearly as bad as most lemmy users make them out to be. I was going to respond to all the takes but there's so many I'll just make some general points

• SOTA (State of the Art) models match or beat most humans besides experts in most fields that are measurable
• I personally find AI is better than me in most fields except ones I know well. So maybe it's only 80-90% there, but it's there in like every single field whereas I am in like 1-2
• LLMs can also do all this in like 100 languages. You and I can do it in like... 1, with limited performance in a couple others
• Companies often use smaller/cheaper models in various products (e.g google search), which are understandably much worse. People often then use these to think all AI sucks
• LLMs aren't just memorizing their training data. They can reason, as recent reasoning models more clearly show. Also, we now have near frontier models that are like 32B, or 21B GB in size. You cannot fit the entire internet in 21GB. There is clearly higher level synthesizing going on
• People often tend to seize on superficial questions like the strawberry question (which is essentially an LLM blind spot) to claim LLM's are dumb.
• In the past few years, researchers have had to come up with countless newer harder benchmarks because LLMs kept blowing through previous ones (partial list here: https://r0bk.github.io/killedbyllm/)
• People and AI are often not compared fairly, for isntance with code, people usually compare a human with feedback from a compiler, working iteratively and debugging for hours to LLMs doing it in one go, no feedback, beyond maybe a couple of back and forths in a chat

Also I did say willfully ignorant. This is because you can go and try most models for yourself right now. There are also endless benchmarks constantly being published showing how well they are doing. Benchmarks aren't perfect and are increasingly being gamed, but they are still decent.