Ensure file io sources get higher priority than closed signal.

This was causing issues where the closed would get called before the io callbacks and removing them...