Hey Gromwie,
No, you don't have to trim the smaller sugar leaves, people get very detailed with their trimming, and really just a preference. My rule of thumb is if it has trichomes on it, then it's smokeable. Congrats on your harvest and Feel free to shoot me a holler if you ever need any help, I'd be honored to assist you. Hopefully, this was helpful, and remember ... "Happy Growing" and "Free your mind one puff at a time".