Everyday
Understanding Unit Conversion Factors
A conversion factor rounded to two decimal places looks precise. Whether it actually is depends on what's behind it.
Published by UseKitl · Last reviewed 7 September 2026
Unit conversion looks like the simplest possible arithmetic — multiply by a factor, done. The part that actually matters is where that factor comes from: some are exact numbers fixed by international agreement, and some are convenient rounded approximations. Treating an approximation as if it were exact is how small, invisible errors get built into things that compound them — repeated conversions, large quantities, or anything downstream that depends on the result.
Exact factors vs rounded approximations
| Conversion | Exact factor | Common rounded approximation |
|---|---|---|
| Inch → millimetre | 25.4 mm exactly | 25.4 (this one is already exact and commonly used correctly) |
| Pound → kilogram | 0.45359237 kg exactly | 0.45 kg, or "2.2 lb per kg" |
| Mile → kilometre | 1.609344 km exactly | 1.6 km |
The inch and the pound both have exact definitions fixed by the 1959 international yard and pound agreement, which defines these customary units in terms of metric ones with no rounding at all. That means a conversion using 25.4 or 0.45359237 is not an approximation — it's the actual, internationally agreed value. "2.2 lb per kg" and "1.6 km per mile", by contrast, are convenient roundings people carry in their heads, useful for a quick estimate but not for anything where the error matters.
Worked example: how much a rounded factor actually costs you
Converting 70 kg to pounds using the exact factor: 70 ÷ 0.45359237 = 154.32 lb. Using the common shortcut of 2.2: 70 × 2.2 = 154.0 lb. The difference — about a third of a pound — looks trivial for one conversion of one person's weight. It stops looking trivial the moment the same shortcut is applied at scale: converting a 20,000 kg shipment using 2.2 instead of the exact factor understates the weight by about 92 lb (44,092 lb exact against 44,000 lb approximated), which is exactly the kind of gap that shows up as a discrepancy on a bill of lading or a customs declaration.
Why conversions go through a base unit
A well-built converter doesn't store a separate factor for every possible pair of units — it defines each unit's exact relationship to a single SI base unit, then converts through that base. Converting inches to centimetres, for instance, goes inches → metres → centimetres, rather than using a directly memorised inch-to-centimetre ratio. This matters because chaining several already-rounded factors together compounds their individual errors, while going through one common, exact base does not.
value_in_base = value × factor result = value_in_base ÷ target_factor
Why temperature is different
Length and weight conversions are pure ratios — double the value, double the result. Temperature scales don't share a common zero point, so converting between them needs an offset as well as a ratio: °F = °C × 9/5 + 32. Applying a pure ratio to a temperature (as you might be tempted to, out of habit, for any other unit) gives a wrong answer at every value except one — the point where the two scales happen to cross.
The trap that isn't about precision at all: US vs UK units
Some of the worst unit errors have nothing to do with rounding — they come from two units sharing a name while meaning different quantities. A US gallon and a UK imperial gallon differ by about 20%, despite both being called simply "a gallon". A short ton (US, 2,000 lb), a long ton (UK, 2,240 lb) and a metric tonne (1,000 kg) are three different masses that all get shortened to "a ton" in casual use. No amount of decimal precision fixes this kind of error — it requires being explicit about which specific unit is meant, on both ends of the conversion.
When to use the full-precision figure
- Anything with legal, medical, financial or safety consequences — shipping weights, medical dosing, engineering tolerances, customs declarations — should use the exact factor, not a rounded shortcut.
- Quick mental estimates ("about 1.6 km to a mile") are fine exactly because they're being used for estimation, not for a figure anyone will act on precisely.
- Rounding for display is fine; rounding before the calculation is not — retain full precision through the arithmetic and round only the number actually shown.
Limitations
- Converting a volume to a weight (or the reverse) requires the substance's density — no unit converter can do this from the units alone, since a litre of water and a litre of oil have different masses.
- Compound or derived units — miles per gallon, pounds per square inch — need their own conversion logic rather than a single length or weight factor.
- Even an exact conversion factor doesn't fix an ambiguous source figure — check which specific unit (US or UK gallon, short or long ton) a number was originally quoted in before converting it.
Sources
- BIPM — SI Brochure: The International System of Units (SI) — the official definitions the metric (SI) system is built on
- NIST — Unit Conversion — US guidance on exact conversion factors between customary and metric units
Found an error or something outdated in this guide? Report a correction.