The town grew up around the Priory dedicated to St Edmund.