My student Koyena Pal will be presenting some cool work at .
Her Future Lens (https://future.baulab.info) can look a single hidden state of an LLM and see what a transformer is planning, several tokens ahead.
It can make reading the internal states much more intuitive!
Look for us if you'll be in Singapore for EMNLP/BlackboxNLP/CoNLL.
Work with Jiuding Sun, Andrew Yuan, and Byron Wallace.
https://twitter.com/kpal_koyena/status/1723026282781581380?s=20