“That just means that the marginalized become an anchor preventing progress.”

And that’s the difference. Progressives view it as important that we progress all groups and that challenge is fundamental to society, whereas you view them as an anchor.