Rowland was born in 1768 in Delaware. Rowland's father was David Perry and his mother was Elizabeth Richard. He had a brother and five sisters, named David, Hannah, Mary, Nancy, Sarah and Elizabeth. He was the second oldest of the seven children. He died at the age of 44 in 1812.