Skip to main content

‘truesight (stylometry)’ directory

See Also

Gwern

“Quantifying Truesight With SAEs”, Gwern 2025

LLMs know more than they say, like who wrote some text. How can we find out these known unknowns of how much they really know, when their internals are a mysterious scrambled blackbox?

But we can possibly use sparse autoencoders to turn their internal thoughts into a long list of simpler properties summarizing what the LLM knows. We don’t know what any of them are, but we can do many things with this summary.

We can find out what an LLM knows about an author by defining that as “the thoughts that it thinks for each of their writings”, and we can use that to define their ‘persona’; now we can make the LLM write like an author, and ‘ask the author questions’ to see what the LLM knows about them.

We can do a lot of other things, too, like see which parts of the text are hints about the persona (to analyze or modify them), or how much text we need for a good persona. We can also look at how their persona changes over time, or whose persona is similar, or how similar their relatives’ persona are (or maybe find those relatives).

Miscellaneous