you could probably train a gpt 2 sized model with sota architecture on a 2008 su...

		adgjlsfhk1 5 days ago \| parent \| context \| favorite \| on: Touching the Elephant – TPUs you could probably train a gpt 2 sized model with sota architecture on a 2008 supercomputer. it would take a while though.