Joseph was born in 1796 in Bradley, Derbyshire, England and his baptism took place there on October 7th, 1792.1 Joseph's father was James Appleby and his mother was Lydia. He had three brothers and three sisters, named John, James, Thomas, Mary, Betty and Ann. He was the fourth oldest of the seven children.