Should I switch off the ventilation system when the building is unoccupied?

It is not recommended to switch ventilation systems off in any buildings, even those temporarily vacated. Instead ventilation systems should be operated continuously at reduced speeds, as stated in BESA VG002 V4 https://www.thebesa.com/media/837990/besa-guidance-vg002-v4.pdf.