Horace was born in 1887. Horace's father was Abel Mather and his mother was Sabina White. His paternal grandparents were James Knowles and Jenny (Jane) Mather. He had two brothers named Abel and Amos. He was the youngest of the three children. He had a half-brother and a half-sister, named James and Sarah.