Sylvester was born about 1172. Sylvester's father was William Talebot and his mother was unknown. His paternal grandparents were William Talebot and unknown. He had three brothers named Roger, Robert and Simon. He was the second youngest of the four children.