tax-exempt breaks invoice

My normal invoice includes tax added and all has been well until I had to add a customer who is tax-exempt.
Now when I try to place the invoice I get a full page of errors regarding duplicate entries of all values.
Do I need to edit report 107 to leave tax out of the invoice?
Then do I change it back again to process a regular invoice?