Alexander was born in 1858. Alexander's father is John Martin and his mother is Deliah Lantz. His paternal grandfather is Benjamin Martin and his paternal grandmother was Rebecca Jolliffe. He had two brothers and two sisters, named Lot, Ben, Margaret and Adaline. He is the third oldest of the five children.