Question about the compensate_beta in pruning depthwise separable layer?

[imyangs]

Dear author, thank u for your excellent work and code. Recently when I read the convert code, I cannot completely understand the logic behand the beta compensate, can you explain it or point out the reference?
BTW, why we only need to compensate beta for pointwise layer rather than both the depthwise and pointwise layers?

ResRep/rr/resrep_convert.py

Lines 201 to 203 in aac6ed3

	for pri in pruned_ids:
	compensate_beta = np.abs(fol_dw_beta_value[pri]) * (pw_kernel_value[:, pri, 0, 0] * pw_gamma_value / np.sqrt(pw_var_value + 1e-5)) # TODO because of relu
	pw_beta_value += compensate_beta