Structural stability of invasion graphs for Lotka-Volterra systems