‌Joseph Madison Carroll and Elizabeth were married.  They had three sons and two daughters, named William L., Thomas S., Joseph G., Sarah C. and Polly T..