James was born in 1880. James' father was James Cross and his mother was Emma Lemon. His maternal grandparents were William Lemon and Susannah Robbins. He had a brother and a sister, named Herbert and Frances. He was the second oldest of the three children. He had two half-brothers named Percy and Thomas.