Unfortunately I think you may have a male, those growths do not look like female calyxes forming.........but it is still a bit early to tell 100% for sure, but I would be worried personally.
Wait another few days and things will become more obvious by then.
You still have plenty of time (2-4 weeks) before any viable pollen is released if it is a male, so no need to do anything drastic as yet.