Riots broke out between Hindus and Muslims in the vicinity of the structure. The colonial British government built a brick wall to divide the Hindu-Muslim areas of worship.