If it was slowed down with a huge pot, it's concentrating on root mass more than above ground and in the end should catch up with some really good growth. Many plants come out fine when put into a too big of a pot.. but the risks are elevated nonetheless and something you can 100% avoid, so it's a no-brainer not to do it. So, don't freak out, you'll probably be fine and the outcome will be fine, assuming competency in other aspects of growing Avoid the elevated risk in future, though.
It is far healthier and optimal to pot up as the plant grows. This helps the root mass develop properly and avoid plants sitting in saturated, stagnating water for 7-10+ days.. just as yo shouldn't leave irrigation water out for several days stangating, the pot shouldn't remain nearly fully saturated for long periods of time, either. If it sits there wet AF for 10 days, you're just cultivating some fucked up biome in the substrate, lol.
You can water a smaller diameter around the plant about as wide as the canopy, but make sure that moisture goes all the way down, or else you'll train shitty, superficial roots. Allow a proper dryback and repeat.. this way roots are trained to grow deeper. Iff you water superficially, you train shallow ('superficial') roots. When any compacting or erosion occurs and tehy get exposed to light, they will differentiate into stem and no longer function as roots.
Depending on growth rate, probably want 25-30 days of growth before they can go into a 5-gallon. The exact point might be influenced by your choices of training.. e.g. good to let them recover a bit from topping before potting up.
Potting up is not stressful if done right. Don't molest the rootball or handle it with some retard strength, and all is well. I've done somewhere approaching 400 up-pots and yet to see one plant get shocked. Make sure it isn't bone dry and the roots are developed enough to hold it together, and you shouldn't have a problem, either. It won't crumble with some common sense.
The only plant i saw shocked was a clone swap i received that had a bad gnat infestation. I removed the substrate, rinsed the roots, then re-potted in fresh substrate. That plant was stalled for about 5-7 days after that, lol, but that's some very high level stress, comparatively speaking.