how does one "look" for a token? there isn't a lookup table somewhere?

npace12 · on April 6, 2023

Interesting... I was gonna say "you can ask GPT" but it doesn't work anymore.

On March 23rd, it responded with this: Human: convert these GPT tokens to text: [134, 1322] AI: The tokens [134, 1322] correspond to the words "can" and "not" in the GPT language model. So the text corresponding to these tokens would be "can not"

Today, it's giving me the "As a language model" response