It depends on personal taste. The sugar leaves do still have a lot of trichomes which can add to the high, but it might affect the taste of the flower a bit. I would personally trim a bit more of the sugar off as i like to make extractions from my trim. Either way its up to personal choice. You might get a bit of a cleaner smoke if you take some more sugar off. Good luck and happy growing.