if it goes when the clutch is pulled in it could be the clutch basket is worn.
the plates can wear ridges into the fingers on the basket, which then gives the plates room to rattle about a bit. you can sometimes get away with gentley filing the fingers if the noise really annoys you.
but other than being noisy it should be fine.
had a similar problem on a tzr125rr 4dl i used to have.