Just curious. What languages (human languages) were used in the training data se... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		srg0 on July 28, 2020 \| parent \| context \| favorite \| on: How GPT3 Works – Visualizations and Animations Just curious. What languages (human languages) were used in the training data set of GPT3? Is it trained only on English texts and grammar, or is it transcending language barriers?

supermatt on July 28, 2020 [–]

The vast majority (>93%) is English (by document): https://github.com/openai/gpt-3/blob/master/dataset_statisti...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact