I think some of this is rooted in white people's perception that Black Americans are a monolithic group (i.e. they are all the same) while they wouldn't perceive white people as all the same. It's the same mentality as when white people tell Black Americans to clean up "their" neighborhoods or do a better job at raising "their" children. Just another form of white racism.