Ban was born on July 27th, 1922. Ban's father was Hồ and his mother was Can Nguyễn Hữu. His paternal grandparents were Mạnh Cung and Hoan (Loan) Đỗ. He has two brothers and three sisters, named Hoan, Ký, Bột, Bật and Tham. He is the third oldest of the six children.