Elizabeth was born in 1742. Elizabeth's father was Edmund Ruffin and her mother was Anne Simmons. Her paternal grandparents were Robert Ruffin and Elizabeth Watkins. She had two brothers and a sister, named James, Edmund and Mary. She was the second youngest of the four children.