James was born about 1613 in England. James' father was Francis Harmon and his mother is Sarah Martin. He had two brothers named Nathaniel and John. He was the oldest of the three children. He had a half-brother and a half-sister, named Miriam and Sarah. He died in 1673.