Boundary criticality of topological quantum phase transitions in two-dimensional systems