No one alive today is owed anything and no one alive today should be put behind someone else based on the color of another's skin. That's the new face of racism in this country and the current generation of shoulder chip-ers that bear the weight of no cross need to get off of that pedestal.
Today, racism is the new McCarthy-ism and the people crying racism are ironically, if not purposefully, instituting racism against other races in the guise of reparations.
If you have any sort of knowledge of sociology and the way the systems in America work today, they are absolutely favoring whites and especially destructive to black communities. There's a great video about it, but I can't seem to find it at the moment. It goes through the various stages of American culture that have kept the African American community from having equal opportunity - from slavery to modern tactics of over-incarceration. This is why Affirmative Action is there, and while it's just a band-aid, at least it's doing
something.
But the reason for Affirmative Action is that the government has not taken the time to actually help solve the issues inherent in maintaining this lack of equality. Between over-incarceration (with obvious profiling), mandatory sentences for minor drug offenses, and re-districting of voting districts, there are numerous ways modern racism continues to rear its ugly head. Unfortunately many ignore it using many of the same arguments you just mentioned. Until this abates, it will continue to be whites vs the rest, because there has been an inherent Affirmative Action for whites in every way imaginable in our society since whites first murdered Native Americans, took their lands and took ownership of it.
There are obvious flaws within our system, and like DeadPres pointed out, it is a system of privilege throughout the world - but in America specifically, that privilege is very obviously doled out most to whites, with people of various colors on various parts of the scale. This isn't to say white people are evil (I'm half white, half asian, if it makes any difference), but that whites have been the ones in the position of power throughout American history as well as making up the majority of the population in America, and until they acknowdedge the facts of our systems, and the problems therein, it will continue to be viewed as an us vs. them mentality. Which is unfortunate, but understandable.
I guess my question is, sure, let's say we get rid of Affirmative Action as it's commonly viewed - would people like chaseter then agree that our justice system and the war on drugs unfairly destroys poorer communities? And then recognize that many more African-American communities per capita are affected by those policies? Including the long term damage done by this overincarceration leading to single parent homes? Where that single parent must work multiple low-paid jobs because of the poor education provided to them because they lack resources? That also means that more of their children are left without parents at home to teach them good values and work ethic and increase the probability that they get into illegal activities with their friends in similar situations because that is the best way they see to having a sense of community and a way to live out of poverty? Or that it is an incredibly difficult task to get a job after a mandatory 20+ year sentence for drug possession when these for-profit prisons do not provide adequate education and resources to give them a fighting chance to get a real job once they get out?
I could keep going, but it is a cycle that is largely ignored by those in power able to do something about it, or by many people in this country in general. This is also why many in those communities are forced to go on welfare - the opportunity is just not there. And when that opportunity is that scarce, is it really surprising that people then take advantage of that system? It's hard to get motivated to try harder when the odds of getting out of that are so small, and even harder to believe in when you grow up with very few people telling you that it's even a possibility.
So until something happens about it, the term 'people of color' will continue. Luckily, we will continue to intermingle, and color will become a thing of the past - and maybe then we'll have a better chance of people just seeing each other as people - and recognize that our systems do a really poor job of helping these people have a true shot at the American dream we still pretend exists, but really doesn't.
/rant