Benki โ†’ All Posts

โ‡  previous page next page โ‡ข

Robin Hanson argues against superhuman general AI as an existential risk.

One point he repeatedly makes is that we already have self-optimizing superhuman intelligences on earth, namely corporations, and they do not appear to be destroying the world.

I donโ€™t buy it. Yes, corporations are self-optimizing superhuman intelligences in a way. But they are severely limited by the slow communication processes inside them. How much faster is communication between neurons simulated by a computer than between human beings? There is no doubt that the difference is quite large. At some point a difference in quantity makes a difference in quality. Not to mention that when viewed in this way, AIs can grow much larger than corporations can.

Asset valuation is necessarily volatile, even with regard to the safest imaginable assets. Therefore, bank failure is a fact of life. Deposit insurance helps some, but it is more complex than you may think and only covers part of what society might want to protect.

โ‡  previous page next page โ‡ข