GROWING BUT NOT EDIBLE

The pomelo tree at my home in Ipoh is bearing quite a number of fruits but then they drop off after a while.  Even those that are slightly big cannot be eaten.  Anybody has any tips as to what I can do to make them grow bigger and be edible?