British Prime Minister Tony Blair came to Washington and spoke to a joint session of Congress on July 17, 2003. Early in his speech he commented, "On our way down here, Senator Frist was kind enough to show me the fireplace where in 1814 the British had burned the Congress Library. I know this is kind of late, but: Sorry."
That may stand as one of the all-time most memorable apologies!