James' father was David Gibb and his mother was Helen White. His maternal grandparents were James White and Mary Galloway. He had two brothers named Thomas and Walter. He was the second oldest of the three children. He died at the age of 74 in 1960 in Whitburn.