In Affirmative Action to be Fair Shouldn't It Be Like This(See details)?

If they are trying to make reparations why not also take points off people who are descended from slave owners? And then shouldn't the descendants of abolitionists get thank-you points for affirmative action? Also to be truly fair you'd have to confirm that the person is in fact descended from slaves to give them points.