Cowl flaps can sap a few knots, yes. But on long cross-country flights I regularly notice my IAS vary by +/- 5 knots, sometimes more. You'd theoretically expect IAS to remain about the same given the same altitude, OAT, config and power settings but it doesn't. It varies even on non-thermally...