The fort has many exciting exhibits like the two guns placed on the western wall and believed to have been cast in Egypt. The bigger one is called the Nilamtope and the other one is known as Kadanal. In and around the fort one can find numerous Buddhist caves belonging to the 200 B.C. to 200 A.D era.
In the Uperkot is a two storied cave said to belong to the initial century which is believed to be a Buddhist Chaitya cave. There are also Buddhist caves at Bava Pyara Math found below the Southern walls of Uperkot arranged in three rows. Scholars believe that they are Buddhist caves perhaps belonging to the period between 200 B.C to 200 A.D.