The prompt may be the same but the seed is different every time. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		koakuma-chan 8 months ago \| parent \| context \| favorite \| on: OpenAI dropped the price of o3 by 80% The prompt may be the same but the seed is different every time.

biophysboy 8 months ago [–]

Could you not cache the top k outputs given a provided input token set? I thought the randomness was applied at the end by sampling the output distribution.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact