May have died in 1822 or 1825, where there are burials recorded with no father (so adult), but sadly no wife named on the transcript. Need to check the original images (were not available).
There are probate records for 5 Apr 1821 (Plumber & Glazier), 14 Feb 1822 (a Shopkeeper) and 24 Jan 1826 (a Weaver).
The 1822 index record reads: Mather John - Charles Mather (executor) of Bolton le Moors. This is significant, as John is Charle's father, Charles Mather was also witness to James's marriage. Also, we know James's father John was a shopkeeper in 1845, so he probably took over his father business.
Name: John Mather
Age: 70
Birth Date: abt 1752
Burial Date: 9 Jan 1822
Burial Place: Bolton-le-Moors, St Peter, Lancashire, England
Reference Number: GB127.L243/1/5/3