Justices of the peace, and other civil officers not herein before mentioned, for crimes or misdemeanors in office, shall be liable to indictment in such courts as the Legislature may direct; and upon conviction, shall be removed from office by said court, as if found guilty on impeachment; and shall be subject to such other punishment as may be prescribed by law.