Yes, you can build a pergola without a permit. The Victorian Building Authority states: “A pergola does not require a building permit, provided it: is not more than 3.6m in height, and. is not more than 20m2 in floor area, and. satisfies the siting requirements (placement on the allotment), which are set out in the Building Regulations 2018 (Schedule 3).”