this post was submitted on 12 Sep 2023
16 points (94.4% liked)

Free Open-Source Artificial Intelligence

2889 readers
2 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 1 year ago
MODERATORS
[email protected]
[email protected]
16
where to start? (lemmy.ml)
submitted 1 year ago by [email protected] to c/[email protected]
4 comments fedilink hide all child comments
 

Hi,

I'd like to explore the possibilities of training a LM to learn a specific programming language so he can be used as co-pilot in that context. Language is a niche language (http://pharo.org), and there is no existing model nowadays knowing it (also, I want to make some extra tweaks, once I have it).
Thing is... I have no idea where to start! :)

Any hint where can I learn the ropes?

Thanks!

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 1 points 1 year ago* (last edited 1 year ago) (1 children)

... stable diffusion is a diffusion model - OP wants a language model. They don't work even remotely the same way.

[โ€“] [email protected] 1 points 1 year ago* (last edited 1 year ago)

I'd agree. And the toolchains aren't proprietary. But they are different and you can transfer only a small amount of knowledge from one to the other. The concept 'training an AI model' is the same. PyTorch, Linux and the graphics card are the same. So you can lean something. But it's another kind of AI model and the software stack you need to use also differs.