Lydia was born in 1821. Lydia's father was Henry Rosier and her mother was Sophia Hunt. Her paternal grandparents were Henry Rosier and Frances Mann. She had two brothers and a sister, named James, John and Emily. She was the youngest of the four children.