It was built in the 9th century on the site of Roman remains, after the settlement existing there at that time was sacked by Omar Ibn Hafsun. The Almoravids and Almohads extended the fortress, which one point had seven towers. The castle had two doorway-towers, the Arco Oscuro arch and the arch of Santa Bárbara. The tower of the Arco Oscuro, also known as the Cabildo or council, has a room with Mudéjar coffering where the first councils used to convene.