On the exquisite balance between skeptical scrutiny and openness to new ideas — and why science has the additional virtue of being true.
◆SAGAN·SKEPTICISM·SCIENCE·PSEUDOSCIENCE·WONDER·COPERNICUS·SETI
On the governance of chance, the tyranny of hope, and the disguises of idleness — from The Rambler and The Idler.
◆JOHNSON·ESSAYS·MORALITY·CHANCE·HOPE·IDLENESS·RAMBLER·IDLER
A collection of aphorisms on the nature of the will, the masks we wear, the consolations of distance, and the pendulum of opinion.
◆PHILOSOPHY·PSYCHOLOGY·HUMAN-NATURE·WILL·INTELLECT·SCHOPENHAUER
This article introduces temporal-difference methods — a class of incremental learning procedures that assign credit by means of the difference between temporally successive predictions. The E=mc² of reinforcement learning.
◆REINFORCEMENT-LEARNING·TD-LEARNING·PREDICTION·MACHINE-LEARNING·MARKOV-PROCESSES·CONVERGENCE
Fast learns, slow remembers. Fast proposes, slow disposes. Fast gets all our attention, slow has all the power.
◆SYSTEMS·CIVILIZATION·COMPLEXITY·TIME·ARCHITECTURE
The enormous usefulness of mathematics in the natural sciences is something bordering on the mysterious, and there is no rational explanation for it.
◆MATHEMATICS·PHYSICS·PHILOSOPHY·EPISTEMOLOGY·BEAUTY·SCIENCE
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin.
◆AI·COMPUTATION·SCALING·SEARCH·LEARNING·HISTORY
Leap before you look
◆POETRY·YEATS·AUDEN
The complete 2009 treatise by Halevy, Norvig, and Pereira on why massive, messy datasets trump elegant theories.
◆MACHINE-LEARNING·NLP·DATA-SCIENCE·GOOGLE·SEMINAL
Working through the original Transformer paper with my own annotations and re-derivations. What they got right, what I still find weird.
◆TRANSFORMERS·ATTENTION·NLP·SEMINAL·AI
The complete technical paper on Archias: a standalone system designed to categorize user queries and shield LLMs from adversarial tactics.
◆EXPERT MODEL·GENERATIVE AI·JAILBREAK ATTACKS·LARGE LANGUAGE MODELS·PROMPT INJECTIONS
394 pieces of advice from Kevin Kelly, one at a time.
◆ADVICE·WISDOM·LIFE·KEVIN KELLY·APHORISMS
◆REINFORCEMENT LEARNING·ARTIFICIAL INTELLIGENCE·AGI·REWARD·INTELLIGENCE
The key to this mystery is to rephrase the question slightly. Why don't smart kids make themselves popular?
◆SCHOOL·NERDS·POPULARITY·ADOLESCENCE·SOCIETY
In debates, the word 'quixotic' is nearly always meant as an insult — which puzzles me, since I can hardly think of a greater compliment.
◆DON QUIXOTE·CERVANTES·LITERATURE·CRITICISM·IMITATION·FAITH
Analogy is anything but a bitty blip — rather, it's the very blue that fills the whole sky of cognition.
◆HOFSTADTER·ANALOGY·COGNITION·LANGUAGE·CHUNKING·PERCEPTION·TRANSLATION·PUSHKIN
The fragments of the stone tablets that Szilard picked up are clearly different in both substance and tone from those which Moses brought down — softer, not nearly so blunt and unequivocal.
◆SZILARD·PHYSICS·ETHICS·COMMANDMENTS·MANHATTAN PROJECT·WISDOM
I couldn't tell you how to be happy, but I can tell you from personal experience how to guarantee misery.
◆MUNGER·WISDOM·INVERSION·COMMENCEMENT·SPEECH
◆RICHARD HAMMING·RESEARCH·CREATIVITY·SCIENCE·LEARNING·BELL LABS
Important aspects of popular songs are best understood in terms of modern complexity theory.
◆KNUTH·COMPLEXITY·COMPUTER SCIENCE·HUMOR·SONGS·ACM
We shall do a much better programming job, provided that we approach the task with a full appreciation of its tremendous difficulty — as Very Humble Programmers.
◆DIJKSTRA·PROGRAMMING·SOFTWARE·COMPUTER SCIENCE·TURING LECTURE·LANGUAGES
Because of its analogies with the rise, fall and alternations of a society of living organisms, it belongs to a growing class of what are called 'simulation games.'
◆CONWAY·GAME OF LIFE·CELLULAR AUTOMATA·MATHEMATICAL GAMES·EMERGENCE·COMPLEXITY
Geographical curves are so involved in their detail that their lengths are often infinite or, rather, undefinable. However, many are statistically 'self-similar,' meaning that each portion can be considered a reduced-scale image of the whole.
◆MANDELBROT·FRACTALS·GEOGRAPHICAL·PAPER
The only way to escape the prisoner's state is to know how the prison is built.
◆CALVINO·TOPOLOGY·ESCAPE·DUMAS·PRISON·MATHEMATICS·LABYRINTHS
What are the tricks, the gimmicks, that actually aid in creative work? I think they can be catalogued — and if one consciously applied them, in many cases you'd find solutions faster.
◆SHANNON·CREATIVITY·RESEARCH·MATHEMATICS·THINKING·BELL LABS
On the impossibility of classifying the universe — and the impossibility of escaping chance.
◆BORGES·LANGUAGE·TAXONOMY·CLASSIFICATION·WILKINS·PHILOSOPHY·CHANCE·LOTTERY·FATE
For me, as for many others, the reading of detective stories is an addiction like tobacco or alcohol.
◆DETECTIVE FICTION·GUILT·INNOCENCE·FORM·CRITICISM
Of all the passions, the passion for the Inner Ring is most skillful in making a man who is not yet a very bad man do very bad things.
◆LEWIS·VIRTUE·AMBITION·FRIENDSHIP·SOCIETY·BELONGING
◆CHESTERTON·ESSAYS·NONSENSE·LEAR·CARROLL·WONDER·INCONVENIENCE·ADVENTURE
◆CHESTERTON·ESSAYS·HUMILITY·EPHEMERAL·MODERNISM
There are people who have but one idea: at least, if they have more, they keep it a secret, for they never talk but of one subject.
◆HAZLITT·CHARACTER·OBSESSION·CONVERSATION·EGOTISM·WIT
Favourite passages from the Art of War in Classical Chinese and Georgian.
◆SUN TZU·STRATEGY·WAR·GEORGIAN·CHINESE
✦ memory · ☽ night · ∞ loops · ❧ margins · ◆ proof
a personal library in perpetual arrangement · MMXXVI