Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
We have no idea how models will behave in production until production (arxiv.org)
38 points by LexSiga on April 15, 2024 | hide | past | favorite | 3 comments


Yes, and building correctness into an LLM-enabled system should be part of the architecture. I’ve been working on this for the 18 months and it’s clear that we’re far from understanding industry-wise patterns that may arise or apply.


> We have no idea how models will behave in production until production

They almost sound like...Human?


"You say our project is a buggy ill-defined mess of slapdash features and spaghetti code interdependencies... but I prefer to think of as almost human!"

I get the joke-association, but if "annoying and complicated" was enough to make something human, then AI happened a long time ago. :P




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: