Herbert was born in 1894. Herbert's father was James Cross and his mother was Emma Lemon. His maternal grandparents were William Lemon and Susannah Robbins. He had a brother and a sister, named James and Frances. He was the youngest of the three children. He had two half-brothers named Percy and Thomas.