Administrative checks and legal stay — how does this even work?

I’m thinking about a situation: if you end up under an administrative review and are waiting for a new visa to be issued, can you legally stay in the country that whole time? Or is it better to sort out getting a new visa in advance, rather than wait for the old one to expire?