I have done privilege walks, though I don't think that is what they were called in the 1980s. I never thought about it before, but you are right. If it wasn't for the presence of marginalized groups, there would have been no point to the privilege walk.