EEVblog Electronics Community Forum

General => General Technical Chat => Topic started by: KJDS on November 25, 2015, 04:22:45 pm

Title: Why won't it go wrong again?
Post by: KJDS on November 25, 2015, 04:22:45 pm
I hate intermittent faults
I hate intermittent faults
I hate intermittent faults
I hate intermittent faults
I hate intermittent faults
I hate intermittent faults

especially ones that appear to have cured themselves, but I just know that if I sell the unit then it will come back the moment the customer turns it on

I hate intermittent faults
I hate intermittent faults
I hate intermittent faults
Title: Re: Why won't it go wrong again?
Post by: AndyC_772 on November 25, 2015, 04:48:22 pm
I hate intermittent faults too
I hate ntermittent faults too
I hate intermittent faults too
I hate intermttent faults too
I hate intermittent faults too
I hate intermittent faults too
Title: Re: Why won't it go wrong again?
Post by: nfmax on November 25, 2015, 04:50:14 pm
Ah yes. You need to ensure the Critical Job Detector Circuit is active for the fault to occur. Been there, done that
Title: Re: Why won't it go wrong again?
Post by: SeanB on November 25, 2015, 04:57:27 pm
ii
Title: Re: Why won't it go wrong again?
Post by: Cubdriver on November 25, 2015, 05:26:23 pm
It will go wrong again.  It just won't do so when you have it apart or are otherwise in a position to fix or troubleshoot it.  The random fault generator has built in sensors that disable it if tools are too close or the enclosure is open and the device under observation by a knowledgeable individual.

 |O

-Pat
Title: Re: Why won't it go wrong again?
Post by: AF6LJ on November 25, 2015, 05:30:18 pm
You have to know how to work the intermittent.
Sitting there, watching it won't make it fail.
Title: Re: Why won't it go wrong again?
Post by: xrunner on November 25, 2015, 05:36:05 pm
I hate intermittent faults
I hate intermittent faults
I hate intermittent faults

Ke p at t un il you su ceed! D n't give p!
Title: Re: Why won't it go wrong again?
Post by: AndyC_772 on November 25, 2015, 06:23:06 pm
Whenever I'm confronted with a problem like this, th6 absolU9& guar*eed wa to fix it i/ to a8&b fqpnUOIUFE 7s8
")b ` ` , wh^ch makes the fault occur every single time, then it's easy to debug it using standard lab equipment.
Title: Re: Why won't it go wrong again?
Post by: gibbled on November 25, 2015, 06:55:59 pm
Bob Pease book "Troubleshooting Analog Circuits" has a page on Troubleshooting Intermittent Problems.

One section reads:

"Try  to  make something happen. Applying heat  or  cold may give you a clue. Adding
some vibration  or  mechanical shock could cause a marginal connection to open permanently,
thus leading to identification of the problem and its solution."

Great book...
Title: Re: Why won't it go wrong again?
Post by: Neilm on November 25, 2015, 07:08:12 pm
Just get a senior manager / customer to test - almost guaranteed it will go wrong.

Title: Re: Why won't it go wrong again?
Post by: AF6LJ on November 25, 2015, 08:08:33 pm
Bob Pease book "Troubleshooting Analog Circuits" has a page on Troubleshooting Intermittent Problems.

One section reads:

"Try  to  make something happen. Applying heat  or  cold may give you a clue. Adding
some vibration  or  mechanical shock could cause a marginal connection to open permanently,
thus leading to identification of the problem and its solution."

Great book...


This is good basic advise; sometimes you have to look for that noisy voltage source or flaky logic levels, but you need to be on the ball when it fails in order to do some ten second troubleshooting.

As for intruducing heat;
Two of the best methods are the 100W incandescent bulb and fixture above the device under test or the towel placed over said device.
Every repair tech should have a goose neck desk lamp and one of those forbidden bulbs to insert in it. for this task. This is gentile on the device in question where a heat gun can do more harm than good in some cases.

Above all if you cannot get the problem to reappear by mechanical shock then check those voltage sources for noise and marginal ripple.
Title: Re: Why won't it go wrong again?
Post by: DimitriP on November 25, 2015, 08:19:25 pm
Faults are permanent. Symptoms are intermittent. :)
They are more fun when you are in R&D mode than production.











Title: Re: Why won't it go wrong again?
Post by: Tomorokoshi on November 25, 2015, 08:51:42 pm
Will you be going to an EMC lab for evaluation? Even if you aren't, you could run it there and get test data. Budget permitting.

Sweep with a Variac?

Switch various loads on and off on the same circuit?

Flex the board?

As said above, heat and cold. Humidity?
Title: Re: Why won't it go wrong again?
Post by: grumpydoc on November 25, 2015, 09:25:28 pm
Just sell it then the fault is sure to come back  >:D

You might have to travel to the buyer's location to fix, of course.

Is it anything especially sexy?
Title: Re: Why won't it go wrong again?
Post by: AF6LJ on November 25, 2015, 09:39:39 pm
I have a reputation for fixing intermittents; fly me over and back and I will fix it.
Title: Re: Why won't it go wrong again?
Post by: KJDS on November 25, 2015, 10:00:34 pm
Just sell it then the fault is sure to come back  >:D

You might have to travel to the buyer's location to fix, of course.

Is it anything especially sexy?

It's one of a pile of radio test sets.

I've monitored the supply rails and they aren't moving when the fault is there.

I think now it's fully warmed up the fault has gone, so I'll leave it in a cold part of the house and see what happens in the morning.
Title: Re: Why won't it go wrong again?
Post by: fivefish on November 25, 2015, 10:54:45 pm
Use the Shaolin Fists of Hammer method.

https://www.youtube.com/watch?v=cJdmQHiXiFs (https://www.youtube.com/watch?v=cJdmQHiXiFs)

Title: Re: Why won't it go wrong again?
Post by: DimitriP on November 25, 2015, 11:47:22 pm
Just sell it then the fault is sure to come back  >:D

You might have to travel to the buyer's location to fix, of course.

Is it anything especially sexy?

It's one of a pile of radio test sets.

I've monitored the supply rails and they aren't moving when the fault is there.

I think now it's fully warmed up the fault has gone, so I'll leave it in a cold part of the house and see what happens in the morning.

Ok, since no one has asked specifically, what make model and symptoms do you have? 
Title: Re: Why won't it go wrong again?
Post by: vk6zgo on November 26, 2015, 12:29:34 am
Take it up in a helicopter---works every time!

I had a small monitor which would fail as soon as it went into service in the "News chopper".
On the ground,you could heat it,freeze it,bash it,& it wouldn't fail!

I finally fixed it by the "scattergun" joint rework technique. ;D
Title: Re: Why won't it go wrong again?
Post by: Radio Tech on November 26, 2015, 12:47:38 am
And I thought this type of fault was normal, at least most of the stuff I work on are like this.
Title: Re: Why won't it go wrong again?
Post by: MarkF on November 26, 2015, 01:17:10 am
I don't understand the problem.

    It's job security!     ;D
Title: Re: Why won't it go wrong again?
Post by: EEVblog on November 26, 2015, 02:00:39 am
Murphy.
Title: Re: Why won't it go wrong again?
Post by: TerraHertz on November 26, 2015, 02:01:15 am
You just need to understand the psychology of the intermittent fault gremlin. They are wily, hostile and ingenious, but may respond to threats. I find walking into the room with a grim expression and a large sledgehammer in my hand sometimes works.


Darnit. My 'm' key is going interittent.

Title: Re: Why won't it go wrong again?
Post by: tonyarkles on November 26, 2015, 03:57:28 am
I do more software debugging than hardware debugging, but I've found this technique seems to be pretty useful: make a list of inputs, and turn them up to 11.

Software-wise, if you have a race condition that occasionally manifests when you've got two threads running... Run 20! A web server that starts having hiccups at 20 requests/second? Hit it with 200 req/sec! A database that occasionally runs out of RAM? Run something alongside it that takes a pile of RAM.

In hardware, it's the same deal. If your inputs are CMOS levels, run them as close to the switching thresholds as possible. Sag your voltage rails. Crank your voltage rails. Add noise to your rails and inputs. Runs your clocks fast. Hot. Cold. 

And write down your hypothesis, along with what experiments you're doing to prove/disprove the hypothesis! Hopefully, you'll figure out what conditions take it from intermittent to consistent.
Title: Re: Why won't it go wrong again?
Post by: Ian.M on November 26, 2015, 04:46:59 am
We used to take stubborn intermittants out on a road trip.  Stick it in the van for the round trip while doing a repair pick-up or drop-off for another customer, then carefully ease it back onto the bench and hope the fault has reappeared.
Title: Re: Why won't it go wrong again?
Post by: calexanian on November 26, 2015, 05:04:26 am
Ah yes. That moment when you would give just about anything to have your product fail in a nice predictable manner.
Title: Re: Why won't it go wrong again?
Post by: cobbler on November 26, 2015, 07:18:25 am
Is it plugged in?
Title: Re: Why won't it go wrong again?
Post by: Zucca on November 26, 2015, 07:24:19 am
I have a reputation for fixing intermittents; fly me over and back and I will fix it.

Gentle women hands can do miracles...
Title: Re: Why won't it go wrong again?
Post by: Rerouter on November 26, 2015, 07:31:45 am
Few things i normally try,

Hit it, repeatably,
Get out a hair-drier and heat up the box to something quite uncomfortable
Add some ground, or supply resistance for its power supply
Load down its outputs
provide a pull up or pull down on inputs or outputs
walk away yelling,
quickly race back and catch the thing off guard
pick up, violently shake object and event bang on bench
Call working, bill for time.
Title: Re: Why won't it go wrong again?
Post by: crispy_tofu on November 26, 2015, 07:40:58 am
I usually give my broken electronics some encouraging words... it's worked a few times!  :-+
Title: Re: Why won't it go wrong again?
Post by: Paul Moir on November 26, 2015, 07:50:48 am
My favourite are the bugs exposed by human factors.  You have some process that works just fine, but then some new operator comes along and things start failing intermittently.   It's a lesson in humility to sit there watching what they do to expose a bug you created because you couldn't conceive of them doing it "that way" and what the consequences were.
** Bonus humility for creating some standard operating procedures which you think will prevent the bug, but then learn it's still present.   Extra bonus humility for blaming the operator (even if only in your mind) for not following the SOPs when in fact they did. **

Electronics and mechanics are easy.  Just regularly approach them with a screwdriver.  Let them know you are not afraid of taking them apart! :)
Title: Re: Why won't it go wrong again?
Post by: crispy_tofu on November 26, 2015, 07:52:52 am
My favourite are the bugs exposed by human factors.  You have some process that works just fine, but then some new operator comes along and things start failing intermittently.   It's a lesson in humility to sit there watching what they do to expose a bug you created because you couldn't conceive of them doing it "that way" and what the consequences were.
** Bonus humility for creating some standard operating procedures which you think will prevent the bug, but then learn it's still present.   Extra bonus humility for blaming the operator (even if only in your mind) for not following the SOPs when in fact they did. **

Electronics and mechanics are easy.  Just regularly approach them with a screwdriver.  Let them know you are not afraid of taking them apart! :)

Reminds me of the 'Antennagate' 'You're holding it wrong' fiasco...  ;D
Title: Re: Why won't it go wrong again?
Post by: Paul Moir on November 26, 2015, 08:03:52 am
That's exactly it Mr. Crispy.  If they had only included a little piece of paper that said "For your proper Apple(C) IPhone(C) experience(C), hold your phone like this:" then you could conceivably blame the user.  You would know in your heart it was really your fault for not providing a robust design, but you can use a SOP to weasel your way out of it.
Title: Re: Why won't it go wrong again?
Post by: Gribo on November 26, 2015, 08:13:05 am
Fluorescent lamps are also useful in such cases, mainly as a noise source at 50 and 100Hz .
Title: Re: Why won't it go wrong again?
Post by: KJDS on November 26, 2015, 07:43:33 pm
I forgot to put it somewhere cold last night, so it's been fine whenever I've tested it today. It's now in a cold room, so will see what it does in the morning.