- Fast environmental changes
Intelligence explosion
Ecological catastrophe
Personal interests
Social feedback
Future impact
INTELLIGENCE STAIRWAY
"Who here wanted to merge again?"
=
"...the last invention that man need ever make"
I. J. Good
1. Live AND <2 neighbours => Die
2. Live AND >3 neighbours => Die
3. Dead AND 3 neighbours => Live
TOY WORLD
REAL WORLD
Narrow AI
2009
2008
1) Avoid AGI
2) Aim for FAI
2010
AGI
2011
2005
Friendly AI
http:blogs.nationalgeographic.com/blogs/blogwild/2009/10/chimps-in-mouring.html
2011
201X
DANGER
1997
Enlightened
Harmless
INTELLIGENCE
FAI
AI safety protocol
Conclusion
1) AGI is ecologicial catastrophe
2) Enlighten AI developers
3) Develop AI safety protocol
Design Power
Control
Speed
Environment
INTELLIGENCE
www.youtube.com/watch?v=WmNczv9jHcg
1 minute ago
Turing complete
RULES
- Any live cell with fewer than two live neighbours dies, as if caused by under-population.
- Any live cell with two or three live neighbours lives on to the next generation.
- Any live cell with more than three live neighbours dies, as if by overcrowding.
- Any dead cell with exactly three live neighbours becomes a live cell, as if by reproduction.
Intelligence Stairway
"Powerful optimization pressures are scary things to be around. Look at what natural selection inadvertently did to itself"
Jaan Tallinn
TIME