Two scales with slightly different spacing
The main scale has one-millimetre divisions. Twenty slightly shorter vernier divisions span nineteen millimetres. Each successive line gains another twentieth of a millimetre.
IN01 · Reading a small length
Why does a finer scale not automatically give a more accurate length? A finer scale resolves smaller changes, but a shifted zero moves every reading together. Check the closed jaws before measuring, look straight at the scale and repeat the contact. Repeating a biased reading does not remove its bias.
Slide a jaw or turn the thimble, read the matching graduations and check the zero. Measure a cylinder, a thin foil or a bore, then compare repeated readings.
Saved simulated measurements
| No. | Main scale | Division | Zero | Corrected |
|---|
Repeated readings estimate scatter. A resolution floor and the saved zero uncertainty are added in quadrature. Viewing bias and a zero changed after calibration can still shift the mean; they are not hidden inside that uncertainty.
The rigid specimen and parallel faces are at twenty degrees Celsius. Contact deformation, backlash, thermal expansion, jaw thickness and alignment errors are omitted. The bore uses ideal thin inside faces; the outside micrometer only measures outside dimensions. These synthetic records are not instrument certification.
The reference is separate from the recorded readings and is never used by the mean or uncertainty calculation.
Physics tutorial
BackgroundA ruler tells you which millimetre you have passed. A sliding auxiliary scale tells you how far you have travelled into the next one.
Why it mattersA useful length measurement needs a contact, a readable scale and a checked zero. Each can fail in a different way.
Start with the essentials
The main scale has one-millimetre divisions. Twenty slightly shorter vernier divisions span nineteen millimetres. Each successive line gains another twentieth of a millimetre.
Count complete half-millimetre sleeve intervals, then add the thimble fraction. Fifty thimble divisions make one turn. A half-millimetre sleeve mark matters as much as a whole-millimetre mark.
The closed faces provide a zero-length reference. Its indicated reading is saved separately for each instrument; changing the instrument later does not rewrite it.
The sample scatter s and count n give the repeat contribution. The scale division d retains a conservative quantization floor, and the last term describes the saved zero. Uncorrected viewing bias and later zero drift are outside this estimate.
Typical misconceptionIf every reading agrees, the result must be exact.
Better mental modelAll readings share the same zero and viewing direction. The repeat scatter can vanish even when the mean is displaced. The resolution floor therefore remains.
Choose Read a cylinder, then Scale close-up. Open the jaw slightly and bring it back into contact.
What to observe: The main scale gives the whole millimetres. The green vernier line gives the remaining fraction. A reading can only be saved after contact.Increase Zero offset in Instrument errors & seed. Keep a reading, choose Close & check zero, then select the cylinder again and save another.
What to observe: The earlier reading keeps its old calibration. The later one subtracts the newly checked zero. More repeats alone cannot remove that shift.Choose Open into a bore. Drag the bright jaw outward until it reaches the inner wall.
What to observe: The jaws stop at the bore walls. For an outside measurement, the contact stops a closing motion instead.Choose Look from the side and switch between Scale close-up and Parallax side view. Set Viewing angle back to zero.
What to observe: The physical opening stays fixed while the two separated scale planes shift in apparent alignment. Repeating from the same wrong angle preserves the bias.How physics instruments measure · Reading path
Articles on this path that use this experiment, followed by the other experiments they suggest.