In that case, I would advise to do the following
1. Login as HR Manager/Admin
2. Go to Leave Types
3. Click on Edit and under Allocated, select Monthly
So, now the leaves shall be allocated only on monthly basis. But for people who already have got the leaves, you might have to manually edit by going to HR Manager --> Leave Balance of all users
Let us know if you face any issues doing this.