It’s not reproducing exact strings in the training data but patterns and pattern... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		thewarrior on Jan 4, 2024 \| parent \| context \| favorite \| on: Understand how transformers work by demystifying t... It’s not reproducing exact strings in the training data but patterns and patterns of patterns. Next token prediction is more intelligent than it sounds

Rastonbury on Jan 4, 2024 [–]

Reminds me of that person who asked chatgpt to make its own language with vocab and grammar rules and translate back and forth, it blew my mind

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact