Honestly, yeah that VPD is a problem in general. You can dig into the science more yourself but the girls need a certain VPD range to do things properly. Over time you'll run into issues. RH itself is misleading but still tells a story here, you would be well served to try to gain some points on that IMO. VPD being out of range is like pH being out of range, you simply lose things in a discrete manner until it is fixed.
The mold growth potential is a lot more advanced than RH although you're generally fine under 60% with good airflow, cultivar depending. At 40% RH, if you aren't controlling more advanced metrics (which no-one outside of a lab is) I would expect your buds to be losing some of their final weight potential as active water is ripped away. New research here is also showing if you are using a traditional AC or dehumidifier to control the RH or temperature, then you're demolishing trichome heads in the process...presumed mechanism right now is local scale VP delta/gradients (caused by compressor cycles in these machines). In other words, 40% RH driven by a machine is like way worse than 40% ambient.
I agree you can push the boundaries of VPD in late flower. To me a VPD greater than 1.4 is pushing it, 1.7 is about as high as I let mine go.