I have encountered the same problem and apparently there are different kind of ants with different interactions. Some grow aphids on your plant, in this case you have to do something asap. Just look under the leafs for them. But if you are fortunate to have a passive kind , just let them be. But monitor constantly.