It's completely up to you. There's a good chance these buds won't be "top shelf" compared to the top of the canopy, but that doesn't make them useless as you can make edibles and concentrates from them - or smoke them in dire times! Lol.
Personally, I'd leave them on and try to remove some of the leaves that might be shading them from above to increase the chance of better buds down there, but it's not incorrect if you decide to cut them off and concentrate on the top layer of buds only.
Good luck!