Gilbert was born in 1300. Gilbert's father is Gilbert Harpur and his mother is Hawise Elmedon. His paternal grandfather is Roger Harpur; his maternal grandfather is Walter Elmedon. He has two brothers named John and Hugh. He is the oldest of the three children.