Thomas was born before 1536. Thomas' father was Robert Baldwin and his mother was Agnes Dolte. His paternal grandfather was John Baldewyne; his maternal grandfather is William Dolte. He had two brothers named John and Richard. He is the youngest of the three children.