Joseph was born in 1628 in England. Joseph's father was Edward Winn and his mother was Joanna or Jane. His paternal grandfather was Winn. He had a brother and two sisters, named Increase, Anne and Elizabeth. He was the second oldest of the four children.