In the settings panel, the Advanced section has a setting for network interface, with a drop down menu of your available network devices. Your VPN connection should appear as a separate device in the list. If you choose that, it will only send data through that device, so if you’re not connected, it has nowhere to send data to.

The github only has a description of the setting, and doesn’t really explain it any more than that.