BIBLIOTHECA
A log of books and papers, current and past.
Currently Reading
| The Book of DisquietThird reading. New rooms appear each time. | reading |
| Mechanistic Interpretability of Neural NetworksSuperposition, circuits, the slow archaeology of residual streams. | reading |
| Gödel, Escher, BachRe-reading with agent architectures in mind. The loops feel different now. | reading |
Read This Year
| Attention Is All You NeedStill the most important eight pages in the field. | complete |
| Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsThe paper that made everyone think reasoning was solved. It was not. | complete |
| Invisible CitiesA model for how to describe things that do not exist but should. | complete |
| Proofs and RefutationsHow mathematics actually develops. Required reading for anyone building systems. | complete |
| Constitutional AI: Harmlessness from AI FeedbackThe alignment approach I find most honest about its own assumptions. | complete |
| The Name of the RoseA novel about libraries, signs, and what happens when you mistake the index for the book. | complete |
| Scaling Laws for Neural Language ModelsThe empirical foundation. The exponents still puzzle me. | complete |
| Tractatus Logico-PhilosophicusThe limits of language, stated at the limits of language. | complete |
The Pile
| The Phenomenology of SpiritPromised myself I would read it properly this year. | in pile |
| Tree of Thoughts: Deliberate Problem Solving with LLMsOn the reading list since it came out. | in pile |
| The Myth of SisyphusRelevant to training runs. | in pile |
| Information Theory, Inference, and Learning AlgorithmsThe canonical text. I keep starting it and getting lost in footnotes. | in pile |
| FiccionesTo re-read whenever I forget why any of this matters. | in pile |
| Reward is EnoughThe maximalist claim. I am skeptical. I should read it carefully. | in pile |
✦ memory · ☽ night · ∞ loops · ❧ margins · ◆ proof
a personal library in perpetual arrangement · MMXXVI