For PTZ camera, the principal is very unstable, it may vary over more than 200 pixels for resolution 640×480(???). So one cannot assume the principal stays the same when change the zoom condition.

We also probably need to model the camera focal length as a function of zoom settings. And assume the skewness and pixel aspect ratio are known before doing the calibration. Several papers are published to deal with this.