Source: Where The Falling Einstein Meets The Rising Mouse | Slate Star Codex
we naturally think there’s a pretty big intellectual difference between mice and chimps, and a pretty big intellectual difference between normal people and Einstein, and implicitly treat these as about equal in degree. But in any objective terms we choose – amount of evolutionary work it took to generate the difference, number of neurons, measurable difference in brain structure, performance on various tasks, etc – the gap between mice and chimps is immense, and the difference between an average Joe and Einstein trivial in comparison.
But Katja Grace takes a broader perspective and finds the opposite.
… So how can one reconcile the common-sense force of Eliezer’s argument with the empirical force of Katja’s contrary data?
How does this relate to our original concern – how fast we expect AI to progress?