An interesting article on LLM's (mostly) linear representation of 'knowledge'

I was reading this today:

2 Likes

Thanks for sharing! The paper had also visualized the outcomes of such representation at different layers for the same input. Interesting.