Based on research, the Constitution gives the President the power to remove executive officials at will, a principle supported by Madison and widely accepted in Congress and the Executive Branch.
The question of whether Congress can restrict the reasons for presidential removal is a subject of debate. Critics have raised concerns about early laws and practices that might imply limitations on presidential removal
However, there was a consensus that the President had the authority to remove officers, and there were no statutes restricting such authority.

Image courtesy of interviewee