‌Gaines and Margaret were married in a religious ceremony on September 18th, 1870 in , Hawkins, Tennessee.  They had two sons and a daughter, named Frederick, John and Martha.