سُنَّةَ مَن قَدْ أَرْسَلْنَا قَبْلَكَ مِن رُّسُلِنَا ۖ وَلَا تَجِدُ لِسُنَّتِنَا تَحْوِيلًا Qur’an Al-Israa (17:77)Sunnata man qad arsalna qablaka min rusulina wala tajidu lisunnatina tahweelan
I.e., the people who drove them away were invariably punished with destruction.
This was no new thing in history. Allah protects His own, and the ungodly cannot long enjoy the fruits of their unrighteousness even if their punishment be delayed a little while.