You need to be careful and do your best to get any metal chips created in the removal process from going into the engine, this is a vacuum port, and any debris will get sucked into the intake where it can create havoc. I would soak the remaining threads with Liquid Wrench, Kroil, or similar product before trying to remove the broken off peice. You should use this stuff on any old rusty crusty parts or bolts before tying to get them out, preferably letting them soak overnight. If it absolutely refuses to come out, you may be able to drill and tap it going down to 1/8 NPT from the current 1/4, then install a longer nipple and a tee for the two vacuum fittings used. When the repair is complete, spray some carb cleaner, starting fluid, or similar stuff around the threads while the engine is idling, and listen for a change in RPM indicating a vacuum leak.