The name of the temple is believed to have originated from the fact that it is located south of Gajisan Mountain or Seokansan Mountain. Built in 824 A.D. (during the 16th year of King Heondeok’s reign), the temple was destroyed during the Japanese Invasions of Korea (1592-1598) and rebuilt in 1674 (during the 15th year of King Hyeongjong’s reign). Since then, it has gone through rebuilding several times. Consisting of 30 buildings, the temple is home to many Buddhist nuns.

Seongnamsa Three Story Pagoda (Local Tangible Cultural Property No. 5) was built in 824 A.D. by Monk Doui, reflecting his wish of protecting the country from foreign invasions. The pagoda was initially placed in front of Daeungjeon, but moved to the current location in 1973. Other notable relics in the temple include the Statue of Monk Doui (National Treasure No. 369), Three Story Sarira Pagoda, and Stone Water Tank (Cultural Property Material No. 4).