A way that is helping me remember is that in the circle diagram, the arrows move to the north from sufficiency to necessity. Therefore, south to north. Probably not applicable every time, though.