This is EXACTLY the wrong thinking I've been pointing out for most of the thread. It's simply not true.
Further, by the same logic you can argue that murder - which is never justifiable by the way (homicide - meaning killing of a human - can be justifiable, but murder never is, although there can be 'mitigating circumstances') - scars all of the people who loved/cared/even liked the vicitim and it affects them and they, in turn affect those around them and so on. And considering that the first group of people affected by a person's murder is considerably larger than the circle affected by a rape victim... logically, murder is worse for society than rape.