I'm sure internally they use it for the system prompt at least, probably since l... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		cma on Aug 18, 2024 \| parent \| context \| favorite \| on: Prompt Caching I'm sure internally they use it for the system prompt at least, probably since launch. And maybe for common initial user queries that exactly match.

Onavo on Aug 18, 2024 [–]

They are certainly not passing the savings on to the users.

minimaxir on Aug 18, 2024 | | [–]

Yet. I suspect OpenAI will release a similar offering soon. (hooray, free market competition!)

HeatrayEnjoyer on Aug 18, 2024 | | [–]

That $100 billion data center has to get paid for somehow.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact