Matthew was born before 1781 and his baptism took place on December 2nd, 1781.1 Matthew's father was Thomas Callaby and his mother was Susan Hull. His maternal grandparents were William Hull and Ann. He had three brothers and two sisters, named Thomas, William, Charles, Jane and Amy. He was the third youngest of the six children.