alignment tax

noun1

1. •
   A cost to the capabilities of an artificial intelligence resulting from the effects of aligning it with human ethics and morality.

   • The fact that larger models are less subject to forgetting may be related to the fact that larger models do not incur significant alignment taxes. — 2021