‌Joseph and Betsey were married in a religious ceremony on November 27th, 1819.  They had two sons and two daughters, named Elisha C., Joseph Billings, Mary Priscilla and Elizabeth.