Joseph was born in 1802. Joseph's father was Adam Howarth and his mother was Ann Aspinall. He had four brothers and three sisters, named William, Ann, John, Adam, Ann, Betty and Mary. He was the fourth youngest of the eight children. He died at the age of 58 in 1860.