ok. the verdict is concluded (without much intefering the board of council
). i've observed and improvement attempted on all involved system. the verdict... there's 200MHz digital/clock/fpga contaminant noise in ground plane of my Hantek 3x25 AWG while generating a signal. whether the "signal" is amplified or attenuated, its there, around 5-30mVpp hard to tell, since its resemble random noise, but closely to 200MHz. its leaked to my attenuator test circuit pictured in the 1st post probably from psu and/or bnc ground connection (what else?) so the small amplitude signal will suffer from this contaminant floor, esp when coupled with capacitor, the noise will leaked to the "signal plane", since i can see my differential amp is unable to reject this "common mode ground" noise (if ever there's such a term
).
solution? none that i'm satified with or can find from. digging mixed signal thread here last night indicates, even the gurus are unable to solve this dark matter unless go to 4th dimension of pcb layer or careful "twinkle little star" gnd method. so, but my mixed signal Hantek 3x25 is 2 layer only, so i guess i cant get rid of it. another solution? buy the more "lab quality" fg. yeah right!
thanks all guys for helping me brainstorming. and i'm sorry i've wasted your precious time.
edit: sorry i forgot to include the sample picture. below is 10mV 10MHz sine i tried to generate from 3x25 directly bnc to bnc probed by dso without the mentioned 1/1000X divider, its noise and its there even from 3x25 original output (removing my modded amplifier). and even the fg is disconnected from usb, there's around 20mV max ringing in my scope screen very close to this 200MHz frequency, i believe its also from my
ext psu. so, thats about it, the Hantek 3x25
and my poorman psu noise limitation.
edit: striked above, not from the psu, i used the 2x12V LA battery, there's also this 200MHz ring, so
not sure what, maybe "natural" harmonics from the system