Portraits of four former House of Representatives speakers who served the Confederacy will be removed from the U.S. Capitol, House Speaker Nancy Pelosi said on Thursday.