The adjustable end stop was not designed for anything beyond gentle collisions when using the magnets. The track-jumping behavior is expected.
To use the end stop with higher-speed collisions, remove magnets from the end-stop, and use the plunger ...