Each principal department shall be under the supervision of the governor and, unless otherwise provided by law, shall be headed by a single executive. The governor shall appoint the heads of executive departments with the advice and consent of the senate. The governor may remove the heads of executive departments. The governor may at any time require information in writing or otherwise from the head of any administrative department, office or agency of the Commonwealth.