Elijah was born in 1835. Elijah's father was William Alder and his mother was Elizabeth Beven. His maternal grandparents were Job sJoshua Beavin and Jane Keats. He had two brothers named John and Alfred. He was the youngest of the three children. He died at the age of 64 in 1899.