‌James K. and Mary Ann were married in a religious ceremony about 1857 in , Hawkins, Tennessee.  They had four sons and a daughter, named Hugh, Thomas F., James L., Joseph R. and Laurie Or Fannie.