Copied from internet, to add something (not necessarily useful) to the debate.
"It is frequently assumed that Great Scott! is a minced oath of some sort, Scott replacing God. The 2010 edition of the Oxford Dictionary of English labels the expression as "dated" and simply identifies it as an "arbitrary euphemism for Great God!"."