@ericaw
Your proposed sentence sounds very natural while the original Japanese one does unnatural. It should be replaced with yours.
わけにはいかない has the connotation of “obligation” or “commitment”. In other words, if the speaker didn’t worry about the female workers, the speaker might be punished or penalized. It doesn’t make sense.