For thirty years, computer vision researchers drew by hand what the machine was supposed to look for in an image: edges, corners, histograms of orientation. Then networks trained on more images and more computation learned those same patterns on their own and beat them. Richard Sutton named the pattern in eleven hundred words on his own website, in 2019: the bitter lesson. Bitter because the sixty years it sums up prove patiently encoded expertise wrong and raw computation right.
Team A: eight domain experts, eighteen months, writing down what they know so the machine can apply it. Team B: the same money spent on data, on search, on rented computation. Over sixty years Team B won more often than not. Hence the question to ask before funding anything: what does this system do with ten times the computation? If it only runs faster, you bought a fixed asset.
This is not a passing opinion. Sutton received the 2024 Turing Award with Andrew Barto, for laying the conceptual and algorithmic foundations of reinforcement learning.
Then comes the disagreement, which is the heart of this portrait. His lesson describes the research frontier, not a company with four thousand rows in a spreadsheet. A lab chasing a record can wait for computation to double. A management team with four thousand rows and one quarter cannot. There, hand-written structure still wins. The portrait says where: when data is scarce, when one example is expensive, when the symmetry of the problem is known. Deep Blue, Sutton's flagship example, carried eight thousand hand-written evaluation rules.
The bitter lesson is true at the scale of a field. Your budget is at the scale of a quarter.
Read the source text: "The Bitter Lesson", Rich Sutton, 13 March 2019.