Can you run any of those models without $20 000 worth of hardware that uses as m... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		oblio 5 months ago \| parent \| context \| favorite \| on: Experimenting with Local LLMs on macOS Can you run any of those models without $20 000 worth of hardware that uses as much power and makes as much noise as a small factory?

segmondy 5 months ago [–]

I run them with under $3,000 hardware and inference is about 500-600watts with no noise.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact