Neutral should not be a problem if the clutch cable is correctly adjusted and the plates are all in spec'

As to the question having the clutch in at the lights for about 3-4mins detrimental to dry clutch?

YES!!

Dry or wet clutch.
Especially on the dry clutch!
It will wear the fibres prematurely and risk warping the steels.