Crowds can be maddening, but the traditional form of the idiom is madding crowd. Madding here bears the now-archaic sense frenzied, so a madding crowd is a frenzied crowd. The word does not survive in modern English outside this idiom. Everywhere else, it gives way to other words.