Book records show he ws born in Pelham, NH

Birth records may actually be christening records.

http://archive.org/stream/historichomesins02cran/historichomesins02cran_djvu.txt

Birth record and name of parents:
https://archive.org/stream/vitalrecordsofbr00brad/vitalrecordsofbr00brad_djvu.txt

Massachusetts, Town and Vital Records, 1620 1988
Joseph Bailey
birth 15 Sept 1766
Birth place Gloucester
Father's name ( Bradford Bailey)

Vital Records of Gloucester, Massachusetts, to the End of the Year ..., Volume 1

Record says Joseph was born in Bradford,  probably born Sept. 17, 1766 P.R 53

Family Record in the possession of Miss Mary B.S. Bailey of Lancaster

https://books.google.com/books?id=FHHRp6wRdqkC&pg=PA790&lpg=PA790&dq=Joseph+Bailey+P.R+53&source=bl&ots=guC4_nEoCQ&sig=jBYhbjvTl8W1b7fIZdhUN-e3gPc&hl=en&sa=X&ved=0CB8Q6AEwAGoVChMI8tbX8b6vxwIVSI0NCh0Inw-B#v=onepage&q=P.R%2053&f=false

http://ma-vitalrecords.org/MA/Essex/Gloucester/aBirthsB.shtml

Living in Rockport at 1850 census with son, son's wife and grandkids

https://familysearch.org/ark:/61903/1:1:MD9P-XNW

https://familysearch.org/search/record/results?count=20&query=%2Bgivenname%3ANathaniel~%20%2Bsurname%3ABailey~%20%2Bbirth_place%3A%22New%20Hampshire%22~%20%2Bbirth_year%3A1703-1703~

P.R 53 says  Aug 23 1764

https://books.google.com/books?id=FHHRp6wRdqkC&pg=PA790&lpg=PA790&dq=Joseph+Bailey+P.R+53&source=bl&ots=guC4_nEoCQ&sig=jBYhbjvTl8W1b7fIZdhUN-e3gPc&hl=en&sa=X&ved=0CB8Q6AEwAGoVChMI8tbX8b6vxwIVSI0NCh0Inw-B#v=onepage&q=Joseph%20Bailey%20P.R%2053&f=false

https://books.google.com/books?id=FHHRp6wRdqkC&pg=PA790&lpg=PA790&dq=Joseph+Bailey+P.R+53&source=bl&ots=guC4_nEoCQ&sig=jBYhbjvTl8W1b7fIZdhUN-e3gPc&hl=en&sa=X&ved=0CB8Q6AEwAGoVChMI8tbX8b6vxwIVSI0NCh0Inw-B#v=onepage&q=Joseph%20Bailey%20P.R%2053&f=false

death record on son, Levi, says Rockport


Dar National Record 410467 says date of birth Aug, 23, 1764

Gloucester Births page 790

Mary Birth P.R 53 says  Aug 23 1764, which is held by relative B. S Bailey

d. recorded in church record at Annisquam

Family record now in possession of Miss Mary B.S. Bailey of Lancaster

Dar National Record 410467

Family record now in possession of Miss Mary B.S. Bailey of Lancaster

about 1850

He lived in Lancaster

Family record now in possession of Miss Mary B.S. Bailey of Lancaster, place of birth is listed on death record of his son Joseph Bailey

Historic Homes and Institutions and Genealogical and Personal Memoirs of Worchester County,  By Ellery Bicknell Crane, page 57


and Dar National Record 410467

Vital Records of Gloucester Joseph was the son of Joseph and Mary

https://books.google.com/books?id=FHHRp6wRdqkC&pg=PA790&lpg=PA790&dq=Joseph+Bailey+P.R+53&source=bl&ots=guC4_nEoCQ&sig=jBYhbjvTl8W1b7fIZdhUN-e3gPc&hl=en&sa=X&ved=0CB8Q6AEwAGoVChMI8tbX8b6vxwIVSI0NCh0Inw-B#v=onepage&q=P.R%2053&f=false

He resided in Gloucester for a few years, then bought a place a mile south of his grandfather's place in Pigeon Cove, Gloucester where he lived the remainder of his years.

He was a soldier in the War of 1812 and was twice taken prisioner, first from a small trading vessel off the Cape of Virginia by an English fleet going down the coast, afterwards on the privaseer "Harpy" taken from a ship they has taken and which he was beginning to sail.. He was held on a prision ship at the Bermuda Islands, also at Halifax, Nova Scotia, finally at Dartmoor in England, where he remained until the end of the war, when he was sent home and had to walk to Gloucester from New York.

Massachusetts Deaths, 1841-1915 for Joseph Bailey
Name:     Joseph Bailey
Titles & Terms:     
Event:     Death
Event Date:     10 Oct 1853
Event Place:     Rockport, Essex, Massachusetts
Age:     63
Marital Status:     Married
Occupation:     Mariner
Birth Date:     
Birthplace:     Rockport
Estimated Birth Year:     1790
Volume/Page/Certificate Number:     v 75 p 151
Film Number:     960169
Frame Number:     
Digital Folder Number:     4145880
Image Number:     186

https://familysearch.org/search/record/results?count=20&query=%2Bgivenname%3AJoseph~%20%2Bsurname%3ABailey~%20%2Bbirth_place%3AMassachusetts~%20%2Bspouse_givenname%3ASarah~%20%2Bfather_givenname%3AJoseph~%20%2Bfather_surname%3ABailey~%20%2Bmother_givenname%3AElizabeth~%20%2Bmother_surname%3ABoynton~

Family record now in possession of Miss Mary B.S. Bailey of Lancaster

d. Essex, MA

Family record now in possession of Miss Mary B.S. Bailey of Lancaster

Family record now in possession of Miss Mary B.S. Bailey of Lancaster

United States Rockport, MA Census, 1870 for Andrew W Bailey
Name:     Andrew W Bailey
Estimated Birth Year:     1799
Gender:     Male
Age in 1870:     71y
Color (white, black, mulatto, chinese, Indian):     White
Birthplace:     New Hampshire
Home in 1870:     Massachusetts, United States
    Household    Gender    Age
      Andrew W Bailey     M     71y
    Abigail N Bailey     F     62y

Massachusetts Deaths, 1841-1915 for Andrew W. Bailey
Name:     Andrew W. Bailey
Event:     Death
Event Date:     07 Jun 1876
Event Place:     Rockport, Massachusetts
Gender:     Male
Age:     77
Father:     Joseph
Mother:     Mary    
Estimated Birth Year:     1799
Volume/Page/Certificate Number:     v283 p265
Film Number:     960209
Frame Number:     
Digital Folder Number:     4221424
Image Number:     293

P.R.53 Gloucester Births, Family record now in possession of Miss Mary B.S. Bailey of Lancaster

Death record says place of birth Pelham, Gloucester

Senile Pneumonia and place of birth Pelham Gloucester in Rockport death records:

https://familysearch.org/search/record/results?count=20&query=%2Bgivenname%3AMary~%20%2Bsurname%3ABailey~%20%2Bbirth_place%3A%22Gloucester%2C%20Essex%2C%20MA%22~%20%2Bbirth_year%3A1787-1789~