Roger de Berkeley, feudal Lord of Berkeley before the grant to Robert Fitz Harding. [Roger] had lost the manor of Berkeley c1152 for temporizing between Stephen I and the Empress Maud (mother of Henry II, who took Berkeley from Roger]. [Burke's Peerage]
----------------------------
HOLDERS of the CASTLE of BERKELEY (III)
ROGER DE BERKELEY, son and heir, who completed the building of the Castle of Berkeley. He suffered much in the wars between Stephen and the Empress Maud, at the hands of Walter, son of Miles, Earl of Hereford. He was deprived of the Manor of Berkeley, &c., about 1152, apparently for refusing to recognise the authorIty of either party, though he was soon afterwards restored to the Honour Of Dursley (c). He died about 1170, leaving issue. The Castle and "herness" of Berkeley were granted by the King [to Robert FitzHarding]. [Complete Peerage II:124, (transcribed by Dave Utzinger)]
(c) The Dursley Lordship continued in his descendants in the male line (the issue of his son and heir, Roger de Berkeley, by Helen, 1st daughter of Robert Fitz Harding, his successor in the lands of Berkeley for eight generations, when Nicholas Berkeley, the heir male, died s.p. in 1382. By the heir general, Robert Wykes, it was alienated in 1564. In 1404, by the death of Sir Nicholas Berkeley, of Coberley, co. Gloucester, the whole of the male issue of Roger, the founder of this race, became extinct.