(Similar to the response for another question.) BERT is a language representatio...

		saurkt on Feb 10, 2020 \| parent \| context \| favorite \| on: Turing-NLG: A 17B-parameter language model (Similar to the response for another question.) BERT is a language representation model while Turing-NLG is a language generation model (similar to GPT). They are not directly comparable (they can potentially be massaged to mimic the other, but, not something that we have done yet.)

Google's T5 paper pretty convincingly combines the two doesn't it?