What I take it you mean is that, if the cutter is cutting on the outside of the piece, it is fine. Cutting on the inside, it digs in.
When you are cutting the outside of the piece, the cutter is rotating clockwise and moving anticlockwise. When it comes to the rounded corner, the natural movement of the cutter is AWAY from the workpiece, i.e. there is no pressure on it to DIG IN. Also (if you have backlash on the machine), there is no pressure on the tool to pull it into the work. It depends on the drive on the motors to move it round the profile of the job
When you are cutting an inside profile, as the cutter comes to the corner, more of the cutter comes into contact with the work, and it pulls in.If you have any backlash on the machine, the available movement will allow the cutter to move towards the workpiece, as the pressure on the cutter changes, with the change in direction. Say you have cut up one side then the backlash has been taken up in a downwards direction.You run along the top (no backlash on that) then you start down the other side, the pressure on the backlash changes to upwards and allows the cutter to move into the work. The same applies on the left and right sides (but with the other axis)
I can only suggest you check your machine for backlash, and if there is any try and get rid of as much as possible mechanically ( I recently changed my machine from ACME screws to ball screws, with a great decrease in backlash) ,and then try to compensate with backlash compensation, which, although tedious, does work.