‌Levi and Mary Jane were married in a religious ceremony in 1838 in Warren County,Kentucky.  They had four sons and three daughters, named James Milton, John B., Perry, William S., Anne, M. Jane and Sarah E..