James was born on January 8th, 1764 in , , Ireland. James' father was Andrew Forgey and his mother was Margaret. He had three brothers named Hugh, John and Andrew. He was the oldest of the four children. He died at the age of 73 on March 17th, 1837 in , Hawkins, Tennessee.