‌James Madison and Sarah F. were married in a religious ceremony about 1852 in , Hawkins, Tennessee.  They had four sons and four daughters, named John, James Madison, Robert L., Absalom, Cornelia, Rebecca, Ardella and Mary Ann.