I would be concerned about sticks or road debris (or rough roads) breaking your fenders. I have broken plastic (SKS) fenders when detouring onto the W&OD horsey trail during construction in the past, so I am wary about rampaging with fenders. I also run my fenders very close, so riding over stuff that sticks to the tire (sand, little rocks, etc.) causes lots of scraping sounds. I’d definitely take them off. I have my fender install/removal down to about a 5-10 minute activity now; I keep considering getting something like a Race Blade to take that down even further, but I do love the full coverage on days like today.