The end result if both parties did that is that they'd each be using each other's definition of anti-Semitism, which would be at least as bad as before :-) Also, the definition of a term may be a major subject of a debate, as transphobia appears to be here.

Few debates have only two parties. Usually there are bystanders to be convinced (or not).