LocalLLaMA

2454 readers

30 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

[email protected]

Has anyone applied tree of thought prompting to r1 yet? (self.localllama)

submitted 1 day ago by artificialfish to c/[email protected]

9 comments fedilink hide all child comments

Generate 5 thoughts, prune 3, branch, repeat. I think that’s what o1 pro and o3 do

you are viewing a single comment's thread
view the rest of the comments

[–] artificialfish 2 points 1 day ago

Actually now that I think about it, LLM's are decoder only these days. But decoders and encoders are architecturally very similar. You could probably cut off the "head" of the decoder, make a few fully connected layers, and fine tune them to provide a score.

permalink
fedilink
source
parent