You don't have to let visitors and contacts chat (but we think it's pretty cool).
Disabling the chat feature will still allow for contact notifications when visitors arrive, and chat settings can be enabled or disabled on each of your buttons.
Start by heading over to the buttons screen. You will then want to select 'Visitor Buttons' and then click "edit" on the button you would like to edit chat options for. Scroll ALL the way to the very bottom where you can turn on or off 'two way chat.' Don't forget to save!