Rav Avigdor Miller on Calling People Fools

Q:  Sometimes we see in the gemara that the chachomim in Eretz Yisroel would refer to the Jews in Bavel as בבלאי טפשאי, those foolish Babylonians. How does that fit together with the idea that you’re not supposed to ridicule people?