Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That's quite expensive indeed. At full context of 200K, that would be at least $3 per use. I would hate it if I receive a refusal as answer at that rate.


cost is relative. how much would it cost for a human to read and give you an answer for 200k tokens? Probably much more than $3.


You are not going to take the expensive human out of the loop where downside risk is high. You are likely to take the human out of the loop only in low risk low cost operations to begin with. For those use cases, these models are quite expensive.


Yeah, but the human tends not to get morally indignant because my question involves killing a process to save resources.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: