The pagodas stand on each side of the platform in the front courtyard of the main hall of ancient Kaiyuan Temple. They were built some one hundred years earlier than Renshou Pagoda; an inscription on the pedestal dates between 1131 and 1162 of the Song Dynasty.
The pedestal of each of the stone pagodas sits on a square brick base. Carved on the four sides of the pagodas are Buddhist images and tales. The five-tier steeples are each about five meters high, but their tips have been destroyed. Judging from the pagodas' carvings and architectural style, the steeples must have been rebuilt, but the framework of the pagodas and the relief sculptures are relies of the Song Dynasty.