The construction of Penrith Castle was begun at the end of the 14th century. It was later transformed into a luxurious residence by Richard, Duke of Gloucester, who became Richard III.