Oobabooga | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ipaddr on Oct 11, 2023 \| parent \| context \| favorite \| on: Mistral 7B Oobabooga

redox99 on Oct 11, 2023 [–]

Ooba is not meant to serve multiple users (no batching). Batching gives you 5x to 10x throughput increase.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact