Allow OWA, but not Outlook Anywhere

Hello,

I want to be able to allow OWA, but unfortunately when we enable Outlook Anywhere the clients outlook app then connects to exchange without the need for VPN.  Ideally we don't want this to happen for secuirty.  Is there a way to configure OWA without the Outlook Anywhere?

Any help is appreciated.