Raising armor rarity adds defense, but skill levels stop changing at a certain point for each piece. After that point, upgrades only add defense.
Rarity of each piece's last skill gain
0 of 176 pieces still gain skills above R11. Use Upgrade Paths to check a specific set before spending materials.