Your fig is probably a little immature to be setting fruit-it needs to develop a strong root system. Also they don't like wet feet-in fact they live in quite inhospitable conditions in the wild!
The citrus also don't appreciate wet feet-what is your soil like? Are there aphids on the new growth?
Where do you live? A little more information may have with your questions....