Hi Bro,
I've got the same issue with my apple tree. Do in this way: get a very thin metallic wire (copper cables, fishing wire, etc). insert it into the hole and try to skewer the bastard. This has worked for me. If U fail with this method, you can try to spray into the tunnel a pyrethroid by using a syringe with needle. This second way should be avoided but could be the last chance to get rid of that worm.