Hi Rudradeb, great article!
It would help to know the data source and more information about the training data. Usually HR satellite imagery (sentinel, landsat or worldview) have more than 3 channels. Did you use any other channels other than these 3 as well to train your model? Did you train your model from scratch or used a pre-trained network?