Did I take too much?

It looks like you took off your future colas... When the plant grows it makes fan leaves. Where the fan leaf meets the stem, you start getting shoots. These become branches and are future bud holders. It looks like that's what you removed. Don't freak out, by the end, this won't affect you too much. Only remove leaves when they're blocking light to a future bud site, when you need better airflow, when the leaf is diseased or dead, or if you're trying to shape your plant in a certain way. When you remove leaves, they should mostly be large, single fan leaves.