From the diary photo, you can see the leaves in the shade turning yellow. If that's the only issue, it's the plant transferring mobile nutrients to the most important part, the buds. You can safely remove them and see if the new leaves also turn yellow, but I don't think so. Anyway, this advice is only valid if the yellow leaves look like those in the photo; if there are more, a more detailed photo would help.