Originally built in the early 16th century by Raja Rudranarayan, the main temple has undergone several modern renovations.

Spread across a large area the temple area includes main temple where MA RAJBALLAVI resides in Garvagriha with a Courtyrad in front .There are four Shiva temples namely SHREE BANESWAR ,  RAJRAJESWAR & NANDISWAR  , SOMESWAR , TROMBOKESWAR  , a large Natmandir, a garden, and a sacred pond or dighi where devotees take holy baths.

Mandir area starts with a NAHABAT KHANA leading to the  main entrance door called Singhaduar because of 2 lions statues above the door.

Behind Main temple there are two large kitchen and several dining halls and areas.

The temple is very active, and devotees from the surrounding region and from far  converge on Rajbalhat to pay tribute to the goddess.