This is just my observation. I've noticed the no smoking symbols on the sidewalks almost everywhere in the big cities when I visited the last two years. They have the smoking "sections" on the big street corners where huge crowds gather. I don't remember seeing a restaurant without ashtrays though.
I love smoking in the LCDHs. I can't compare it to other countries, but you just can't beat Japanese service. The ones in Shibuya and Roppongi are my favorite. Prices are up there though.