Troops opened fire after the man jumped into the Imjin River and ignored repeated warnings to stop.
North Korea and South Korea remain technically at war after the 1950-53 conflict ended in an armistice and not a peace treaty.
There are thousands of North Korean defectors living in South Korea, but few attempt to make the journey the other way.
Instances of trying to cross the heavily-militarized border in broad daylight are extremely rare.
The incident comes as South Korean workers returned to the Kaesong industrial park in North Korea, five months after work was halted amid high political tension.
The man, who has not yet been identified, was spotted by guards near the western border in Paju, north of Seoul, at around 14:23 local time.
Soldiers fired off warning shots and told him to return to the South. When he disobeyed the order and jumped into the river, he was shot dead, military officials told Yonhap news agency.
A military spokesman also told the AFP news agency that the man’s body has been retrieved.
The shooting comes amid a thawing of ties between the North and the South as more than 800 South Koreans poured into the jointly-run Kaesong industrial complex.
The zone, just inside North Korea, is home to 123 South Korean factories that employ more than 50,000 North Koreans.
It is the last functioning inter-Korean joint project and a key source of revenue for Pyongyang.
But the North withdrew all of its workers in April, as ties between the two Koreas deteriorated in the wake of Pyongyang’s February 12 nuclear test.
Reopening Kaesong complex has taken months of negotiation.
The US House Ethics Committee has voted to release its report on former Republican Representative…
ABC News has agreed to pay $15 million to President-elect Donald Trump to settle a…
South Korea’s parliament has voted to impeach President Yoon Suk Yeol over his failed attempt…
Israeli war planes have carried out more than 100 air strikes in Syria on December…
President-elect Donald Trump has threatened to impose 100% tariffs on the BRICS countries if they…
Syrian troops have withdrawn from the city of Aleppo following an offensive by rebels opposed…