Yes, you can disable overages at any time so that your app does not use more than the amount that comes with your plan (plus any additional workload you may have purchased via a workload tier).