Mathematician and physicist John Baez declares himself fascinated by exceptions in mathematics. This interest has led him to study the octonions, and, through them, to find out more about the origins of complex numbers and quaternions. In the first of two articles, he talks about connections between algebra and geometry, and the importance of lateral thinking in mathematics.