The IRS took millions from innocent people because of how they managed their bank accounts, inspector general finds.