‌James and Fanny were married in a religious ceremony on November 29th, 1859.  They had four sons and eight daughters, named Hugh, Samuel James, Robert, William, Leapha Ann, Mary Elizabeth, Jennet, Margaret, Sarah, Martha Ann, Fanny Ethel and Stella.