Yup this is for sure not all the outputs, but these are all in sequence, so it's able to output this quality consistently. It's just really good at generating human-like output. I posted a link to a Gist with full playground file in one of the other comments here, that included both my seed prompts at the top and then all the OpenAI answers below.
Regardless, maybe I or someone else can create a post with a random set of questions / answers to show a more unbiased view of the GPT-3 outputs.
Have you tried giving it a problem and having it come up with questions that you you answer? Given it’s clearly making assumptions and conclusions, it would be so interesting to play 20 questions with it. Something like... I’m thinking of an animal. Will GPT-3 start general and get to an answer?
I actually did this and while it follows the conversation quite well I think it’s really hard to make the argument that there was a decision early in the text what animal it thought of. That would only be possible if there were hidden embeddings in the output but that’s not possible after the output is converted into text. And I’m not sure how you’d prove that an animal was embedded in earlier layers since it’s pretty hard to inspect these neural networks.
Regardless, maybe I or someone else can create a post with a random set of questions / answers to show a more unbiased view of the GPT-3 outputs.