Joseph was born in 1840. Joseph's father was Henry Wild and his mother was Ann Stocks. His maternal grandparents were Job Stocks and Mary Whitehead. He had three sisters named Mary, Jane and Susannah. He was the second youngest of the four known children.