The first mention of the village of Skalice Hor Stříbrný dates back to 1361 under Ctibor of Skalice, who also had the patronage right to the church of St. James in Rovná. It is not documented whether the castle existed earlier (according to archaeological findings, however, there was a settlement on the castle hill as early as the 13th century) or whether it was built under this owner or his son Střížek of Skalice, mentioned in 1376, or Kuneš of Skalice, mentioned in 1377.