Japan's Nikkei share average stumbled on Monday after North Korea conducted its most powerful nuclear test yet, and some traders expect more selling once the US market reopens after a holiday.

The Nikkei fell 0.8 per cent to 19,527.75, slipping from Friday's two-week high while the broader Topix declined 0.9 per cent to 1,605.15.

North Korea has on Sunday conducted its sixth and most powerful nuclear test, which it said was of an advanced hydrogen bomb for a long-range missile, prompting the threat of a “massive" military response from the United States if it or its allies were threatened.

All but one of the Tokyo Stock Exchange's 33 industry subindexes were down.

“Few investors are trading today. So in that sense, markets are not fully digesting all the factors. I would say we could see more downside moves,” said a trader at a Japanese brokerage.

After North Korea's previous nuclear test on September 9, 2016, Japanese shares ended almost flat, only to suffer a sharp fall the following Monday after big losses on Wall Street. The S&P 500 fell 2.4 per cent on that day.

But traders suspect the market will soon rebound once the initial fears stemming from the nuclear test fades.

“Markets do not expect the nuclear test to lead to an immediate military confrontation. People have learned that markets will take North Korea's actions in their stride,” said Takashi Hiroki, chief strategist at Monex Securities.

“Some investors will see the fall as a good bargain-hunting opportunity,” he added.

While many institutional investors stayed on the sidelines, Japanese retail investors sold small-cap shares, which have been popular in recent months.

Among them mobile game developer Klab fell as much as 10 per cent to a 2-1/2-month low.

Topix small fell 1.7 per cent, while Topix 100 dropped 0.8 per cent.

The index of Mothers start-up firm shares dropped 2.9 per cent, edging near its three-month low touched in mid-August.

Bucking the trend, Sompo Holdings rose 2.7 per cent after the company announced late on Friday that the property and casualty insurer agreed to sell British unit Sompo Canopius to streamline its overseas businesses.

Ishikawa Seisakusho , which makes naval mines, soared 13 per cent on the rising North Korea tensions.

Toyota Motor shares were flat, outperforming the overall market, after the company reported strong US sales in August.