The access/opportunity/etc are what is being referred to as privilege, not the quality granting it. In a world where being beautiful doesn't come with advantages, there is no "privilege of beauty", just beauty