... And probably get hauled off by security or even worse the Police?

It would be unwise for security to physically "haul" you off unless you were being violent, and even if they call the police, they will simply tell you to leave and not come back. Cops won't touch or arrest you in this situation unless you refuse to comply.

You may or may not get the answer you want, but there's not much they can do about you making the attempt.

So make sure you accidentally fall down on the way out and counter sue for GBH

Don't forget that your potential new employer will probably be contacting your old employer for a reference ...

At a small company, you could probably explain the situation.