First, there's nothing you can do to "speed up" their growth except get light to them... You might try just some tucking - take the larger leaves that are shading them and tuck them under and away from the bud sites so that they're exposed... I also think that removing them isn't a bad idea if they're really small (some call me a heretic!) - but what's the point of asking the plant to put its energy into small bud sites that aren't going to be worth a damn? I'd rather the plant send its energy to the GOOD bud sites! But it's your call....
Good luck!