rjmoon, Leon offered good advice -- I wear a mask when I'm going to be exposed to dust.
I have a portable particulate sensor that measures airborne particulates in two sizes. Drying off with a clean bath towel after a shower, crumpling a dry paper towel in the kitchen, struggling to put on a long sleeve clean cotton shirt (because I am half asleep) -- all of these things will temporarily raise the particulate count and trigger my coughin up mucus. For the 0.3 micron measurement, it increases from 100 or so to 1,000 or so.)
None of the 3 situations I mention above are likely to have dust mites, but the particulates themselves are, as you suspected and Leon mentioned, irritant.
My workarounds are dry off with an XXX heavyweight t-shirt instead of a towel in the bathroom (much less lint), tear off paper towels from the roll at arms length and fold them gently, and I hold my breath when I pull on my overhead shirts.