Robert Cartwright married Mary, the only child of James and Elizabeth Boardman, a wealthy maltser, warehouseman and property owner, of Buxton, at the Old Parish Church, Manchester, on May 16, 1796.
On August 28, 1809, Robert and Mary, together with five of their children, Anne, Elizabeth, Richard, Thomas and baby John went aboard the convict ship 'Ann'. Their eldest child, James Boardman Cartwright, was an 11 year old student at the Manchester School remained, as a boarder, to finish his studies. The Cartwright family arrived in Port Jackson on Tuesday, February 27, 1810.