Acting Internal Revenue Service Commissioner Melanie Krause informed her staff Tuesday she is leaving the agency amid internal chaos and the exodus of several senior IRS officials, according to two current IRS employees and one former IRS employee.