Harbaugh: The last three games tipped the scale to Colin