In 1165 Hugh Bigot built a castle at Bungay which was destroyed by King Henry II, In 1294 Hugh’s descendant Roger Bigod replaced the castle at Bungay.  This castle is now also a ruin but the two tall towers of the gatehouse and part of the thick-walled keep can still be seen.