The Secretary shall strictly conform to all the regulations in these laws; and in case of refusal or neglect of his duties, or for any improper conduct, the President shall have power to suspend him from office pending investigation; and the President shall, within three days, lay the reason of such suspension before the Committee, who shall take the same into immediate consideration.