Frederick was born in 1866. Frederick's father was George Hayhurst and his mother was Sarah Mather. His maternal grandparents were Robert Mather and Grace Wood. He had a brother and two sisters, named Herbert, Mary and Annie. He was the youngest of the four known children.