According to researchers in the original paper, with minor fine-tuning, GPT-3 achieves strong performance on many NLP datasets, including translation, question-answering, and cloze tasks. It can also accomplish several tasks that require on-the-fly reasoning or domain adaptation, such as unscrambling words, using a novel word in a sentence, or performing 3-digit arithmetic.
Surprisingly enough, it also can achieve, as the authors described, “meta learning”, which means GPT neural network doesn’t demand to be re-trained in order to perform a task such as sentence completion. The team also finds that “GPT-3 can construct samples of news articles which people will get conflict in order to recognize articles transcripted by humans.”