I haven't dealt with this, but I can offer some input about referrals. Sometimes the "issue" is outside the scope of the midwife's expertise, and in that case they'd rather be safe than sorry, so they refer you. Try not to worry about this!
I have an ovarian cyst, and when I was pregnant they referred me to a doctor at the hospital for it, because the midwife didn't know much about it. It turns out it was all fine and the doctor basically just told me a little bit more about it, but nothing drastic happened.
They would rather refer you and have it turn out to be nothing than not refer you and have problems happen, if you know what I mean. Doctors with more experience will probably be able to give you information about the issue than your midwife can.
I hope it's all okay for you!