Lemon tree

My lemon tree is doing bad and good at the same time. I do not know what the heck is happening. I am losing leaves but the fruit is doing ok i guess. . it is turning yellow and seems to get bigger.. still the size of a quarter. I must do a little research.