The castle is attested since the early years of the thirteenth century and it belonged to the Pannocchieschi Counts, from them derives its name. Today there is a massive tower, incorporated by buildings constructed at a later date, with a sloping base and crenellations supported by stone arches set on shelves.