You mean people who are productive don't have time to harass other people? That does not sound convincing, because there a plenty or documented events were that happened.
Or do you mean, people who are productive don't have time to defend themselves against harassment? In this case you are definitely blaming the wrong people because you should blame those who still don't manage to keep the workplace, and the rest of society, free of sexism, racism and so on.
