this post was submitted on 02 Aug 2023
24 points (100.0% liked)

Free Open-Source Artificial Intelligence

2872 readers
36 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 1 year ago
MODERATORS
 

Hello everyone - I have some YouTube resources I'm excited to share with you today.

Below you will find two videos on how to train/fine-tune commercially viable free and open-source AI/LLMs on your own dataset (Falcon & Llama-2).

I will soon be going through both of these workflows and sharing my results here.

AI Jason's Falcon-7B Training & Fine-Tuning Tutorial

PromptEngineering's Llama-2-7B Training & Fine-Tuning Tutorial

Most of the work is done in Google Colab - a cloud collaboration notebook that can run code. If you use the free tier, it may take longer to follow along - but the workflow is there.

Depending on your dataset and goals, it might be worth considering an upgrade to your plan when you're ready to train a final version.

If you end up publishing a model, don't be afraid to share them here!

Post your datasets too!

Update [9/23/23] This guide may be outdated! Check out the resources on the side bar or visit the HyperTech Workshop for an aggregated linkhub of resources you can explore (from training, tuning, deploying, and serving your on LLM at all stages see the ๐Ÿ“บ YouTube section for those tutorials and amazing content creators!).

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 2 points 1 year ago (1 children)

@Blaed @fosai Amazing job! I will take a look once I get it running on my local machine. Tutorial look lit ๐Ÿ”ฅ

[โ€“] [email protected] 1 points 1 year ago

GL, HF, and happy devving!