Electronics > Beginners
Frequency error in scientific notation
(1/5) > >>
tkamiya:
I feel very dumb asking this but I'm confused. 

I've been tuning a Rb time base.

Say output is 10MHz, and reading is 10.000,000,000,5Mhz, what is the error rate in scientific notation? 

Is it 5x10^11 or 5x10^12?

For this, please ignore factors such as gate time and accuracy vs precision argument.  I just want to know mathematically which is right.
awallin:
I get 5e-11 or 5*10^(-11)
Domagoj T:

--- Quote from: tkamiya on February 02, 2019, 04:09:18 pm ---10.000,000,000,5Mhz

--- End quote ---

This is meaningless, unless you want to say it's a 10 GHz frequency, but thousand separator is not used on the right side of the decimal mark.
What does the "." stand for and what does the "," stand for?
Pick either one for thousand separator and don't use it for decimal.
tkamiya:
THAT depends on country you learned math.  In United States, this is one of the valid expressions.  Please note, the unit is MHz.  So it's "slightly off" 10MHz.  Therefore, decimal "." is in the right place.  Thousand separator can go right and left.

How do I know this?  I work as a programmer for a major company.  Numerical notation is a complex business.  In some country, it even use "'" (apostrophe).  There are at least 20 different way to write the same number.

Either way, I would have hoped my intention was apparent from context.
tkamiya:
This makes me very happy.  I am working with newly acquired Rb oscillator.  Maximum drift seems to be 5 count in last digit, which is exactly the specification.  At this kind of precision, it is challenging my GPSDO lab standard. 
Navigation
Message Index
Next page
There was an error while thanking
Thanking...

Go to full version
Powered by SMFPacks Advanced Attachments Uploader Mod