Those in the “nay” will point out that, by definition, a word that modifies a noun or a pronoun is an adjective; therefore, if an adverb is describing a noun or a pronoun, it qualifies as an adjective and needs to be categorized as such. The Yeas will then counter with two points.

Can a adverb modify a noun?

Introduction to Adjectives and Adverbs. Adjectives modify nouns and pronouns; adverbs modify verbs, adjectives, and other adverbs.

Do adverbs always modify nouns?

While answering to this question here, very interesting discussion took place with CopperKettle. It's absolutely right that adverbs modify many things, but nouns/pronouns.