Hello Evan0327,
I have no experience with calibrating of an endoscope and don't know if it is even possible, because it is very special. But I would start with a hollow cube of known dimensions with a good texture inside and some known distances (perhaps scale paper), not much bigger than 10*10*10cm. I would then shoot enough shots (at least 10, better more) from the inside, from so many different positions/ perspectives as possible, I would also rotate the endoscop around its longitudinal axis for some shots. If you are lucky, the inside of the cube can be modelled with Agisoft PhotoScan and you get your calibration values. For the lens I would expect a fisheye lens type, which can be choosen in PhotoScan's camera calibration menu for your imported cameras.
Hope it helps a little bit to start,
Kiesel