After a long deep meditation in the caves at Himalaya, he travelled to many provinces. In 1826, he reached Puri as Dhulia Gosain and settled on the dusty roads of Puri.
It is believed that once Gosain was invited to Puri Mukti Mandap, where he confirmed that Brahma is Nirguna and Sunya.
After that he moved to hill caves of Khandagiri, Dhauligiri, Nilagiri in 1838 he moved to Kapilash hill (Dhenkanal, Odisha) and spent 21 days in Atma Yoga Samadhi which means unification of human mind, with Balkal of kumbhi tree (bark of careya arborea) and a seven-hooded snake spread its hood covering his head. The nearby area of the forest was enlightened by the lustre of the body of Swami.
On the 21st day, Sadananda, a tribal from nearby Deogram village, witnessed the superlative Atma Yoga Samadhi and served him fruits during the stay of Swami at Kapilash hill (almost 12 years) for which Mahima Swami came to be known as Phalahari Gosain.
After then, Swami survived on cow’s milk for next 12 years. The milk was rendered as service by King Bhagirathi Bhramarbar Bahadur, the ruler of Dhenkanal.
Thereafter, Swami moved to Kakanpada village of Rairakhol with Sidha Govinda Baba (Swami’s first disciple).
It is also said that he made an appearance to Poet Bhima Bhoi and blessed him with eyesight. After seeing the Swami, with all humbleness, the poet prayed to the Swami to make him blind again, saying the torture of mankind was intolerable for him. Swami blessed him to compose a poem on Nirguna Brahman to spread the Mahima religious group. After this, Swami went back to Kapilash hill.
Swami travelled around 24 years as Brahmabadhuta which means wandering mendicant of supreme order and spread the Mahima Dharma in Odisha and neighboring states. After then, he took Samadhi at Joranda on the 10th day after the new moon, 1876.