this post was submitted on 18 Oct 2024
253 points (99.2% liked)
Programming Horror
1891 readers
1 users here now
Welcome to Programming Horror!
This is a place to share strange or terrible code you come across.
For more general memes about programming there's also Programmer Humor.
Looking for mods. If youre interested in moderating the community feel free to dm @[email protected]
Rules
- Keep content in english
- No advertisements (this includes both code in advertisements and advertisement in posts)
- No generated code (a person has to have made it)
Credits
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Fair play to Open AI - I still think LLMs are overhyped, but they're moving things along constantly in impressive ways.
Honestly the use case i'm working on is pretty mind blowing. User records an unstructured voice note like "i am out of item 12, also prices of items 13 & 15 is down to 4 dollars 99, also shipping for all items above 1kg is now 3 dollars 99" and the LLM will search the database for items >1kg (using tool calling) then generate a JSON representing the changes to be made. We use that JSON to make a simple UI where the user can review the changes - then voilà it's sent to the backend which persists the change in database. In the ideal case the user never even pulls up the virtual keyboard on their phone, it's just "talk, check, click, done".
Human in the loop systems with LLMs really nicely deal with a lot of their problems. Very cool! Do you have specific change "types" that the system is able to propose? I guess restricting the response to the right types is covered by your JSON schema?