Harry was born in 1516 in Cadden, Dorset, England. Harry's father was Harry Vye and his mother was Agnes Smith. He had two brothers and three sisters, named John, Robert, Agnes, Ellen and Johane. He was the oldest of the six children. He died at the age of 42 on October 11th, 1558.