Rav Avigdor Miller on Raising Poor Children

Q: What is the pshat in the ma’amar chazal that tells us that we should be careful with poor children because they are the ones who will become talmidei chachomim?