The Mirror of Language

We, as humans, sometimes receive streams of tokens and produce tokens in response, forming words, sentences, lines of code ... but always with the ability to peek outside the stream and check in with ground-floor reality. We pause and consider: does this word really stand for the thing I intend it to stand for? Does this sentence capture the real e... See more

Something that’s been on my mind is flipping the relationship between the human and language model when going through a creative process. It seems that we often want to ask questions of language models, and we expect them to brainstorm ideas or give us answers, but I wonder if another fruitful pattern here is having models ask questions of us .