It’s no different than cruising along in E and having less than BCC. No one is going to enforce that. But, I’d never tell the OP to bust a reg out of convenience either. It’s up to him if he wants to adhere to rules that stringently.
He should know though, that if indeed he did require a SVFR...