The message says that the sender, who allegedly has a firearm, intends to pursue the Koreans.
Also in the envelope was a bullet from a short-barreled weapon.
“Koreans, get out!”, The publication quotes a statement from the letter.
A letter without a sender address was received by the embassy last week.
Earlier, Japan protested to South Korea over the exercises at the disputed islands.