this post was submitted on 13 Feb 2024
63 points (93.2% liked)

Technology

58303 readers
61 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 17 points 8 months ago* (last edited 8 months ago) (3 children)

Well they fuggin broke it.

I've never had it act more stupid than it has today. I'm literally about to cancel and try Gemini Advanced or CoPilot Pro.

Anyone got any experience with either, I'm all ears.

[–] RonSijm 5 points 8 months ago* (last edited 8 months ago) (2 children)

I use Copilot, but dislike it for coding. The "place a comment and Copilot will fill it in" barely works, and is mostly annoying. It works for common stuff like "// write a function to invert a string" that you'd see in demos, that are just common functions you'd otherwise copypaste from StackOverflow. But otherwise it doesn't really understand when you want to modify something. I've already turned that feature off

The chat is semi-decent, but the "it understands the entire file you have open" concept also only just works half of time, and so the other half it responds with something irrelevant because it didn't get your question based on the code / method it didn't receive.

I opted to just use the OpenAI API, and I created a slack bot that I can chat with (In a slack thread it works the same as in a "ChatGPT context window", new messages in the main window are new chat contexts) - So far that still works best for me.

You can create specific slash-commands if you like that preface questions, like "/askcsharp" in slack would preface it with something like "You are an assistant that provides C# based answers. Use var for variables, xunit and fluentassertions for tests"

If you want to be really fancy you can even just vectorize your codebase, store it in Pinecone or PGVector, and have an "entire codebase aware AI"

It takes a bit of time to custom build something, but these AIs are basically tools. And a custom build tool for your specific purpose is probably going to outperform a generic version

[–] [email protected] 1 points 8 months ago (1 children)
[–] RonSijm 1 points 8 months ago (1 children)

Well I have Copilot Pro, but I was mainly talking about GitHub Copilot. I don't think having the Copilot Pro really affects Copilot performance.

I meanly use AI for programming, and (both for myself to program and inside building an AI-powered product) - So I don't really know what you intend to use AI for, but outside of the context of programming, I don't really know about their performance.

And I think Copilot Pro just gives you Copilot inside office right? And more image generations per day? I can't really say I've used that. For image generation I'm either using the OpenAI API again (DALL-E 3), or I'm using replicate (Mostly SDXL)

[–] [email protected] 2 points 8 months ago (1 children)

I mainly use it for troubleshooting stuff, which includes everything from bash to node and react, Python to ..DNS. idk.

Copilot Pro, confusingly, isn't GitHub copilot related. I do have GitHub copilot, I agree gpt4 is better in general, just not in my IDE.

Idk how Microsoft has bungled this naming... They own GitHub now right?!

So there's Microsoft Copilot, which is like bing chat for windows. But now there is Microsoft Copilot Pro for $20/mo, which uses gpt4 turbo. Haven't seen much on it.

And even more recently, Google Bard is now Gemini, but you can do Gemini Ultra for $20/mo. Supposedly trying to contend with ChatGPT 4 as well.

[–] [email protected] 0 points 8 months ago* (last edited 8 months ago) (1 children)

Idk how Microsoft has bungled this naming

You haven't followed been following Microsoft for long have you? The first version of Windows was version 3.0 (there were technically earlier versions but they were "a work in progress" and weren't really usable at all). The third version of Xbox was called "Xbox One".

[–] [email protected] 2 points 8 months ago

I have been using Windows since before 3.0.

Your point, while comical, is kind of irrelevant as far as naming two independent products the same thing.

[–] [email protected] 2 points 8 months ago

I've briefly used bard before they rolled it into Gemini and bard was really quick and accurate. Now that bard is Gemini they seem to have deliberately handicapped the performance of the free product as it really needs very specific prompts to get an answer that's helpful and takes twice as long as bard. Currently I use codeium (not to be confused with codium which is another ai code product) for code reviewing and a linter, and bing AI for general questions. Bing AI is quick, but I've noticed it provides the simplest and quickest answers it can provide, almost like it provides the first answer it finds and nothing else, that can be good and bad. As for copilot, I refuse to pay for it because it really is a good product and should be available to everyone that wants to learn coding, but I get it, they gotta make money I just think it's bullshit to withhold something like that.

[–] [email protected] 1 points 8 months ago (1 children)

I tried Gemini and it did some of the worst writing I’ve seen in some time. YMMV

[–] [email protected] 1 points 8 months ago (1 children)

Did you pay for advanced or are you referring to the thing everyone has access to?

[–] [email protected] 2 points 8 months ago (1 children)

Free one. I found it to be a lot worse than Chat GPT’s free tier. I didn’t test it mega in depth but I threw some of the same “rewrite this copy but make it better in <this> way” sort of tasks I’ve used GPT for and it turned around ridiculously bad writing.

I then asked it if it thought that what it had produced was good writing and comically it told me that it was bad and full of cliches and that I should avoid using it. I’m not making that up.

[–] [email protected] 2 points 8 months ago

I'm not interested in reviews of the free tier. I'm looking to see how ChatGPT4 compares with Copilot Pro and Gemini Advanced.