High Mahalo, you've got 2 plants so I would separate them first so the hermie will not pollinate the female plant.
When you got space for the other one too grow I would cut off the pollen sacks and bananas first. And then see what is happening. It happens sometimes that a plant makes a few pollen sacks and bananas during pre flowering because of stress. And most of the times they will stop producing male flowers after and producing big fat buds. You still need to check every time you water for new pollen sacks or bananas. When it becomes too much and you got to cut away pollen sacks and bananas every time you water I would just throw her away. The seeds got high chance to be hermie as well so I would not waste my time on it and just focus on the female plant.
So goodluck and a happy and healthy 2023