Rowell was born in 1841. Rowell's father was Mr. Quick and his mother was Mary Quick. He had three brothers and two sisters, named Green, Hampton, Gee, Arminta and Nancy. He was the second youngest of the six children. He had a half-brother named Alexander.