this post was submitted on 20 Feb 2024
154 points (91.0% liked)

Technology

58303 readers
26 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 8 months ago (1 children)

It's not exactly training, but Google just recently previewed a LLM with a million-token context that can do effectively the same thing. One of the tests they did was to put a dictionary for a very obscure language (only 200 speakers worldwide) into the context, knowing that nothing about that language was in its original training data, and the LLM was able to translate it fluently.

OpenAI has already said they’re not making that publicly available for now

This just means that OpenAI is voluntarily ceding the field to more ambitious companies.

[–] [email protected] 6 points 8 months ago (1 children)

Gemini is definitely poised to bury ChatGPT if its real world performance lives up to the curated examples they've demostrated thus far. As much as I dislike that it's Google, I am still interested to try it out.

This just means that OpenAI is voluntarily ceding the field to more ambitious companies.

Possibly. While text to video has been experimented with for the last year by lots of hobbyists and other teams, the end results have been mostly underwhelming. Sora's examples were pretty damn impressive, but I'll hold judgment until I get to see more examples from common users vs cherry-picked demos. If it's capable of delivering that level of quality consistently, I don't see another model catching up for another year or so.

[–] [email protected] 2 points 8 months ago* (last edited 8 months ago) (1 children)

Sora's capabilities aren't really relevant to the competition if OpenAI isn't allowing it to be used, though. All it does is let the actual competitors know what's possible if they try, which can make it easier to get investment.

[–] [email protected] 1 points 8 months ago* (last edited 8 months ago)

They are allowing people and companies to use it, it's just limited access. I do not think it's a good idea for them to open it to the public without plenty of safeguards. Deep fakes are becoming way, way too easy to manufacture nowadays, and I'm in no hurry to throw even more gasoline on a fire that's already out of control.