David was born in 1674. David's father was John Lee and his mother was Mary Hart. His paternal grandfather was John Lee; his maternal grandfather was Stephen Hart. He had three brothers and two sisters, named John III, Stephen, Thomas, Mary and Tabitha. He was the second youngest of the six children.