Two methods have been proposed to quantify the extent of skin involvement in scleroderma. These are (1) a scoring system which quantifies and summates this severity rating in 17 areas of skin surface and (2) a method estimating the percentage of skin involvement using a shaded manikin. We report on a study comparing the inter-observer reliability of these two approaches using the ratings of six clinicians on 12 patients. Systematic bias between observers was noted with both methods, but inter-observer agreement, as assessed by the intraclass correlation coefficient (ICC), was higher with the score method. The manikin method resulted in a greater degree of disagreement between the observers, as well as a higher amount of random error, reflecting the difficulty of defining the bounds of abnormal skin. Despite the presence of bias, the score method is the preferred method for assessing the level of skin involvement.