When performing RPC Orthorectification, the error reported is meters. If performing image to image registration, it is in pixels. For the Image to Map, it can be considered pixels related to a pixel size, so it could be interpreted as pixels or meters.