The main problem with this expression is that it has some very negative connotations. The word “dumb” can be used to mean “stupid”. For example:
a) Sometimes he can be so dumb.
b) I’m not dumb, you know!