It's the opposite. When someone says you are "talking down" to them by using big words, the solution is to dumb it down with simpler words, not to increase the vocabulary.