It depends on what you are going for my friend!
I try to think of it this way.
Clear = Not Ready. No sweet goodies in the bulbs yet.
Milky = Added terps and THC, good for me!
Amber = The more amber, the more night-time medicine it becomes for me due to the added CBN conversion.
Basically, you want to try and have most of them at milky stage. As little clear, or none if at all possible. As for the amber, that is a personal preference for the kind of smoke you want. More day time, keep it milky and minimal amber (5-10% tops). If you want a nice chill smoke for the night time, wait til around 15-20% amber.
These are just basic guidelines that I go by. I hope that helps!