James was born in 1889. James' father was Kelly and his mother was Margaret Kelly. He had a brother and a sister, named Thomas and Mary. He was the second oldest of the three children. He had four half-brothers and three half-sisters, named John, Patrick, Michael, Roddie, Maggie, Annie and Bridget.