Compare that speed with the Sun's orbital speed around our galaxy. Based on your comparison, do you think the galaxy's gravity would be strong enough to retain the supernova debris if there were no interstellar medium to slow it down?
Supernova debris moves about 100 times faster than the Sun. The gravity of galaxy alone would not retain the supernova debris.