I was wondering about going the other way, not up to a larger set of speakers, but down from a 12" (HR Deluxe) to a 10" (Pro Junior) speaker. I was hoping to get quieter, not louder

Thinking it would sound more Pro Juniorish, less HR Deluxish. So, I'm just wondering if that will harm my HR Deluxe ?