EEVblog Electronics Community Forum

General => General Technical Chat => Topic started by: gnif on July 30, 2017, 11:53:21 pm

Title: Server Error Reports
Post by: gnif on July 30, 2017, 11:53:21 pm
Hi All,

This thread is to create a central place for reporting server errors instead of having a multitude of threads for such things.

Please do NOT reply to this thread unless you have been instructed to by an error message.

This is NOT for general forum usage issues, this thread is for server outages, configuration problems, etc.

Please Note: I provide gratuitous server support to Dave as a way to support this great community, as such my support is best effort. Please be patient, I am subscribed to this thread and will be notified of your posts.

If any of the below hold true DO NOT post a report.
If none of the above hold true, please post a detailed error report, the more information the better. Things that help are:

As is the same with EE, the more detail about what led up to the issue, the higher the odds are of finding the cause and correcting it.
Title: Current Server Status
Post by: gnif on July 30, 2017, 11:54:14 pm
Current Status: OK

29/08/2017: We are performing some changes to how backups are handled which is causing some slowness, please be patient while we get this sorted out.
30/08/2017: The new backup system is in place, but will be running concurrently with the old backup system while it's performance is evaluated.
03/10/2017: The server was restarted to lift some network restrictions that HostGator had in place that were causing issues with the new backup system. Not sure why a restart was required but this is what we were advised.
11/11/2017: We are now on a new backup scheme but are still experiencing the 502 issues, but much less frequently now. There are core dumps from PHP appearing that need to be debugged when I get some time to do so.
Title: Re: Server Error Reports
Post by: MK14 on August 03, 2017, 04:13:49 pm
EDIT: already my second attempt at making this report. The first just hanged forever, then said error. (Sorry, I should have noted what the error said).

I've just got and seen the new 502 error message. Which instructed me to write a message here.

Over the last day or so, the EEVblog website, although it works fine about 90% of page loads. Seems to take ages to load, perhaps 10% of the time. Especially when making posts or editing.

I have also had problems with other websites, so the problem could be at my end. About 10% of websites are problematic and take ages to load, then just fail or hang forever.

EDIT: More detailed report:

Time was about 5:13 PM 3/8/17 UK time.

The page I was accessing was:
https://www.eevblog.com/forum/unreadreplies/ (https://www.eevblog.com/forum/unreadreplies/)

The web browser I was using: Google Chrome with Adblock Plus.

It said:

Quote
502 - Bad Gateway
We are having server side difficulties and are working to resolve these issues as fast as we can.

If you are able please report this error to this thread. But before posting please read the instructions carefully!

Thank you for your patience,
Dave & gnif

EDIT3:
When a page has an intermediate error message, BEFORE getting to the page. It looks like this:
Quote
This site can’t be reached

www.eevblog.com (http://www.eevblog.com)’s server DNS address could not be found.
Search Google for eevblog forum chat public transport hell people
ERR_NAME_NOT_RESOLVED

Which MAY be an occasional problem at MY end. Sorry. I have had to change (or consider changing) the default DNS server, previously. Because my ISP one, can be problematic.
Title: Re: Server Error Reports
Post by: gnif on August 04, 2017, 05:21:38 am
The 502 is certainly server side and not caused by your client. I have noted a few pages with slow load issues I am still looking into, one of which is loading a profile page. In future please post the time in GMT so I don't have to guess at your timezone and try to figure this out (not one of my strong points).
Title: Re: Server Error Reports
Post by: tautech on August 09, 2017, 12:16:34 am
Blinking forum just apparently ate a post that took me 30 minutes to put together.  :rant:
The display came up with a Cloudfare-EEVblog server page with a red cross on the EEVblog server.
~10am Sydney time.
Chrome

BUT it did post.  :-//
https://www.eevblog.com/forum/testgear/owon-xds3202e-vs-siglent-sds1202x-e/msg1276504/#msg1276504 (https://www.eevblog.com/forum/testgear/owon-xds3202e-vs-siglent-sds1202x-e/msg1276504/#msg1276504)

So false alarm but it did give me a sick feeling.
Back to normal now.
Title: Re: Server Error Reports
Post by: Ian.M on August 28, 2017, 04:17:54 pm
Its the first time I've seen your new Bad Gateway page (since you fixed the session data problem.)
Quote
502 - Bad Gateway

We are having server side difficulties and are working to resolve these issues as fast as we can.

If you are able please report this error to this thread. But before posting please read the instructions carefully!

Thank you for your patience,
Dave & gnif
It was at 28/08/2017 16:09:13 UTC while refreshing https://www.eevblog.com/forum/unread/ (https://www.eevblog.com/forum/unread/)

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.17pre) Gecko K-Meleon/1.6.0

The page reloaded correctly a couple of minutes later.

HTH. ;)
Title: Re: Server Error Reports
Post by: Richard Crowley on August 29, 2017, 05:00:27 am
Same here in Oregon, USA 2017-08-29 @ 4:56 UTC
New error message, and then loaded OK a couple minutes later.
Title: Re: Server Error Reports
Post by: gnif on August 29, 2017, 11:11:38 am
Hi All,

Sorry for the delay in this update, I have setup a new backup system on the server to resolve these issues but it's initial sync has been problematic. Once the intial backup has been completed the old backup will be turned off resolving the recent errors.

For the technical minded:
Title: Re: Server Error Reports
Post by: Ian.M on August 30, 2017, 08:48:38 am
It dit it again, and reload didn't help.  Same browser as before. Time 30/08/2017 08:43:47 UTC.   I *ASSUME* you haven't been able to turn the old backup off yet.

Edit after seeing reply by Gnif:   Sorry!  In my defence 08:43:47 UTC is 09:43:47 GMT which is clearly before 10:00 GMT.   If you want us to ignore errors from 09:30 GMT to 10:30 GMT please say so explicitly.
Edit2: Correction after seeing reply by Salbayeng.  Sorry about the brain-fart re: GMT/BST  *NOT* adding a new post because I don't have another error to report.
Title: Re: Server Error Reports
Post by: gnif on August 30, 2017, 08:49:52 am
It dit it again, and reload didn't help.  Same browser as before. Time 30/08/2017 08:43:47 UTC.   I *ASSUME* you haven't been able to turn the old backup off yet.

  • Check the next post under this one to see if we have announced an expected outage, or that we are working on the current outage.
Title: Re: Server Error Reports
Post by: salbayeng on August 30, 2017, 08:38:48 pm
@Ian.M ?que? 
Quote
08:43:47 UTC is 09:43:47 GMT
Both UTC and GMT are the same for most purposes (GMT does not have summer time adjustments, so local time in the UK will be different by an hour in summer).
One adjusts for leap seconds as they occur, the other adjusts for leap seconds at the end of the year.
The UTC time standard is physically located at a naval observatory in the USA.

GPS time is nearly the same, but doesn't correct for leapseconds, it is currently about 20secs away from UTC (however all GPS receivers know the difference and will tell you UTC if asked).
Title: Re: Server Error Reports
Post by: edavid on August 30, 2017, 10:30:06 pm
502 error at 2017-08-30 22:21:34 UTC

Firefox

https://www.eevblog.com/forum/unread/ (https://www.eevblog.com/forum/unread/)

(but it was affecting all pages)
Title: Re: Server Error Reports
Post by: gnif on August 30, 2017, 11:42:23 pm
502 error at 2017-08-30 22:21:34 UTC

Firefox

https://www.eevblog.com/forum/unread/ (https://www.eevblog.com/forum/unread/)

(but it was affecting all pages)

Again, check the status post, you can clearly see it is 'WiP" and there is additional information stating the details of the work in progress.
Title: Re: Server Error Reports
Post by: edavid on August 31, 2017, 12:26:25 am
Again, check the status post, you can clearly see it is 'WiP" and there is additional information stating the details of the work in progress.

I don't understand, are you saying we should not report errors if the status says "OK - WiP"?
Title: Re: Server Error Reports
Post by: gnif on August 31, 2017, 12:51:32 am
Again, check the status post, you can clearly see it is 'WiP" and there is additional information stating the details of the work in progress.

I don't understand, are you saying we should not report errors if the status says "OK - WiP"?

Quote from: gnif
If any of the below hold true DO NOT post a report.
  • Check the next post under this one to see if we have announced an expected outage, or that we are working on the current outage.

You experienced an outage, but the status states we are working on it and there are dated status updates below it.
Title: Re: Server Error Reports
Post by: edavid on August 31, 2017, 12:55:52 am
You experienced an outage, but the status states we are working on it and there are dated status updates below it.

Maybe I'm dense, but that was not at all clear to me.  Why would I think that the fact that you are working on the backup system means I shouldn't report a 502 error?

(Or maybe you could change the 502 error message when you don't want reports.)
Title: Re: Server Error Reports
Post by: gnif on August 31, 2017, 01:11:28 am
You experienced an outage, but the status states we are working on it and there are dated status updates below it.

Maybe I'm dense, but that was not at all clear to me.  Why would I think that the fact that you are working on the backup system means I shouldn't report a 502 error?

(Or maybe you could change the 502 error message when you don't want reports.)

Sorry, I will try to be clearer in the status updates from here on in :)
Title: Re: Server Error Reports
Post by: RGB255_0_0 on August 31, 2017, 04:11:27 pm
You know about the 10AM issues...

FYI, I just had a 502 at 5:08PM BST.
Title: Re: Server Error Reports
Post by: gnif on August 31, 2017, 04:12:39 pm
You know about the 10AM issues...

FYI, I just had a 502 at 5:08PM BST.

Quote from: gnif
Report Status: Outages are to be expected, reports are not needed at this time.
Title: Re: Server Error Reports
Post by: McBryce on September 04, 2017, 11:28:31 am
502 error at 13:00 German time.

McBryce.
Title: Re: Server Error Reports
Post by: Cerebus on September 28, 2017, 04:16:13 pm
502 for "https://www.eevblog.com/forum/blog/?action=post2;start=100" at 17:15:30 GMT.

Also got a "the last post from your IP address" rate limiting message 2+ minutes after posting this message.
Title: Re: Server Error Reports
Post by: ChrisLX200 on September 29, 2017, 09:59:20 pm
502 - Bad Gateway  10:55pm GMT
Title: Re: Server Error Reports
Post by: gnif on October 02, 2017, 09:04:17 am
Just a little update, we are still working on fixing a known issue (actually, the same issue). I have been away and have not had the opportunity to perform some changes that are required to proceed with the fix. I should be able to free up time in the next few days and work with Dave to schedule some downtime required to put the new system into effect.
Title: Re: Server Error Reports
Post by: guenthert on October 09, 2017, 09:48:44 am
502 just happened here (Berlin/Germany) around 9:40 zulu.
Title: Re: Server Error Reports
Post by: nugglix on October 09, 2017, 09:57:55 am
Same for Hamburg/Germany.
Title: Re: Server Error Reports
Post by: Cerebus on October 12, 2017, 09:47:21 pm
502, 22:47 BST
Title: Re: Server Error Reports
Post by: T3sl4co1l on October 14, 2017, 11:00:17 pm
Just now.

Tim
Title: Re: Server Error Reports
Post by: electricForce on October 21, 2017, 11:33:34 pm
Just now. Austin, TX
Title: Re: Server Error Reports
Post by: suicidaleggroll on October 23, 2017, 10:45:22 pm
Couple of hours ago from Boulder, CO.  Couldn't get in for 5+ minutes (not sure how long exactly as I stepped away from the computer and just got back).
Title: Re: Server Error Reports
Post by: ChrisLX200 on November 01, 2017, 10:21:32 pm
Dammit - again just now (10:20pm), and it lost my carefully worded post :(
Title: Re: Server Error Reports
Post by: sokoloff on November 02, 2017, 09:54:17 pm
~55 seconds ago, from Cambridge, MA. Multiple 50x errors attempting to access https://www.eevblog.com/forum/unreadreplies/ (https://www.eevblog.com/forum/unreadreplies/) from both a cookied browser window and a new Incognito browser window.

Probably 15-20 seconds of outages/repeated failures, then it worked.
Was directed here, followed directions (or tried to), so posting.

Chrome Version 61.0.3163.100 (Official Build) (64-bit) on MacOS.
Title: Re: Server Error Reports
Post by: kalel on November 02, 2017, 10:05:14 pm
Just a few min ago, Chrome.
Title: Re: Server Error Reports
Post by: EEVblog on November 02, 2017, 10:07:17 pm
Dammit - again just now (10:20pm), and it lost my carefully worded post :(

Don't think I've ever lost a post. I just hit the back button and the text is still there in the edit window.
Title: Re: Server Error Reports
Post by: ChrisLX200 on November 02, 2017, 10:14:50 pm
Quote from: EEVblog on Today at 09:07:17 AM (https://www.eevblog.com/forum/index.php?topic=92714.msg1339637#msg1339637)>Quote from: ChrisLX200 on Yesterday at 09:21:32 AM (https://www.eevblog.com/forum/index.php?topic=92714.msg1338714#msg1338714)
Dammit - again just now (10:20pm), and it lost my carefully worded post :(

Don't think I've ever lost a post. I just hit the back button and the text is still there in the edit window.



Nope, it wasn't. The back button took me to an empty editing window (well, actually a quote but my added text was missing).
Title: Re: Server Error Reports
Post by: Richard Crowley on November 02, 2017, 11:41:02 pm
Don't think I've ever lost a post. I just hit the back button and the text is still there in the edit window.
Yeah, that works sometimes.  It depends on when/where the error happens.
I have seen it happen both ways.  Although much more often on GearSlutz than here in EEVblog.
Their server (s?)are chronically slow. Sometimes so slow you wonder whether they are even "up".
Title: Re: Server Error Reports
Post by: bitseeker on November 04, 2017, 05:24:15 pm
The link element for the forum's RSS feed (in the <head>) points to a URL that returns 403 Forbidden.

<link rel="alternate" type="application/rss+xml" title="EEVblog Electronics Community Forum - RSS" href="https://www.eevblog.com/forum/.xml/?type=rss" />
Title: Re: Server Error Reports
Post by: Muttley Snickers on November 06, 2017, 03:43:26 am
502 - Bad Gateway

At 14:25 AEDT or 03:25 GMT on 06/11/17 the forum main page dropped out and then returned to normal operation after about a minute or so with the assistance of the refresh button, as this interruption did not correspond with the scheduled regular backup time I thought it was worth a mention.   
Title: Re: Server Error Reports
Post by: hermit on November 07, 2017, 10:03:07 pm
I just got back in after a brief interruption.  Seems to happen once a day for the past few.  4:45 Eastern.
Title: Re: Server Error Reports
Post by: gnif on November 10, 2017, 11:09:56 pm
502 - Bad Gateway

At 14:25 AEDT or 03:25 GMT on 06/11/17 the forum main page dropped out and then returned to normal operation after about a minute or so with the assistance of the refresh button, as this interruption did not correspond with the scheduled regular backup time I thought it was worth a mention.

I thought it wasn't even supposed to happen with a regular scheduled backup anymore.

Correct, there is still a very intermittent fault, each problem we fix exposes another one. I am seeing core dumps from PHP now, I just have not had the time to attach a debugger to one yet and see what is going on.
Title: Re: Server Error Reports
Post by: kulla on November 11, 2017, 02:53:56 pm
You might as well try to enable slow log for php-fpm for requests that take lot of time and time out in the end, requests that need more than 10s and see what you get and why
Title: Re: Server Error Reports
Post by: gnif on November 11, 2017, 03:27:05 pm
You might as well try to enable slow log for php-fpm for requests that take lot of time and time out in the end, requests that need more than 10s and see what you get and why

It is enabled, we are not seeing slow requests anymore, its a backend crash.
Title: Re: Server Error Reports
Post by: SkrillBill on November 20, 2017, 09:56:30 pm
Error 502 just happened to me. Error instructed me to post in this thread. See attached.


Title: Re: Server Error Reports
Post by: Mr. Scram on November 20, 2017, 10:10:31 pm
I've experienced intermittent 502 server errors for the past few weeks, after they've been absent for a while. The most recent ones were just now, about 10-20 minutes ago. They tend to be on all pages, and typically last for about 1-3 minutes.
Title: Re: Server Error Reports
Post by: gnif on November 20, 2017, 10:17:01 pm
Thanks guys, I will see if I can trace down the cause. It's great there are getting fewer, it makes it easier to find the trigger in the logs :)
Title: Re: Server Error Reports
Post by: Mr. Scram on November 20, 2017, 10:28:56 pm
Thanks guys, I will see if I can trace down the cause. It's great there are getting fewer, it makes it easier to find the trigger in the logs :)
Yes, I though you had the problem solved for a while. It's progress nonetheless :)
Title: Re: Server Error Reports
Post by: SkrillBill on November 21, 2017, 10:10:14 pm
Recieved error 502 while browsing the open source hardware section of the forum. Stayed that way for 3-5 minutes. I tried going to the main website (eevblog.ocm) and was greeted by "Error establishing database connection".

Happened around 5:04pm Eastern

Title: Re: Server Error Reports
Post by: gnif on November 21, 2017, 11:00:37 pm
Recieved error 502 while browsing the open source hardware section of the forum. Stayed that way for 3-5 minutes. I tried going to the main website (eevblog.ocm) and was greeted by "Error establishing database connection".

Happened around 5:04pm Eastern

Thanks, that a new one.
Title: Re: Server Error Reports
Post by: SkrillBill on November 22, 2017, 10:05:17 pm
Recieved error 502 while browsing the open source hardware section of the forum. Stayed that way for 3-5 minutes. I tried going to the main website (eevblog.ocm) and was greeted by "Error establishing database connection".

Happened around 5:04pm Eastern

Same thing happened again, 5:01pm eastern.
502 Error follows by "error establishing a database connection" on the main site.
Title: Re: Server Error Reports
Post by: MK14 on November 22, 2017, 10:08:42 pm
Recieved error 502 while browsing the open source hardware section of the forum. Stayed that way for 3-5 minutes. I tried going to the main website (eevblog.ocm) and was greeted by "Error establishing database connection".

Happened around 5:04pm Eastern

Same thing happened again, 5:01pm eastern.
502 Error follows by "error establishing a database connection" on the main site.

I also had error 502 (lasting for a few minutes) and "error establishing a database connection" on the main site.".

A few minutes ago. It is now 10:07 PM UK time.

At the start of the difficulties, the forum was failing to supply me with pictures. Then a minute or so later, I got the 502 errors. (Probably because I tried to reload the page, because of the missing pictures).
Title: Re: Server Error Reports
Post by: Gyro on November 22, 2017, 10:09:29 pm
Error 524 Ray ID: 3c1f2717f9e435a8 • 2017-11-22 22:00:34 UTC
A timeout occurred

Followed by repeated 502 errors.

I seem to run into a block of 502 errors every day at some arbitrary time between 21.40 and 22.30 BST.
Title: Re: Server Error Reports
Post by: bitseeker on November 22, 2017, 10:10:36 pm
I got hit by the 502s on the forum at about the same time as well.
Title: Re: Server Error Reports
Post by: Muttley Snickers on November 22, 2017, 10:33:43 pm
502 - Bad Gateway

At 09:00 AEDT or 22:00 GMT on 23/11/17 the forum main page dropped out and then returned to normal operation after about two minutes or so with the assistance of the refresh button, this interruption appeared to correspond with the scheduled regular backup time but it was mentioned in a recent post that these events should no longer be occurring, I do not know whether events around this time window are to be ignored or informed.
Title: Re: Server Error Reports
Post by: tautech on November 26, 2017, 12:35:58 am
For a few minutes ~1.23PM NZ (11.23AM Sydney) time all attempted contact was 502's.
Came right on its own.
Title: Re: Server Error Reports
Post by: ez24 on November 26, 2017, 12:38:13 am
Maybe caused by a power overload, 121 gigawatts ?
Title: Re: Server Error Reports
Post by: gnif on November 26, 2017, 01:20:11 am
Maybe caused by a power overload, 121 gigawatts ?

It certainly was, this time it wasn't a server issue as such, it was simply an inrush of hits to the shop to buy meters.
Title: Re: Server Error Reports
Post by: bitseeker on November 26, 2017, 03:29:10 am
Woah, EEVblog suffered from the EEVblog effect.
Title: Re: Server Error Reports
Post by: kulla on November 27, 2017, 10:13:28 pm
Had 502 past few minutes  :-\
Title: Re: Server Error Reports
Post by: ChrisLX200 on November 27, 2017, 10:17:43 pm
  Error 502 Ray ID: 3c4867e87c146ab5 • 2017-11-27 22:08:34 UTC  Bad gateway
Title: Re: Server Error Reports
Post by: MK14 on November 28, 2017, 09:52:55 pm
I got error 502, for around 4 to 4.5+ minutes.
It is now 9:52 PM UK time.

(yesterday, at around this time, maybe 10:18 PM ?, I also had error 502 for a couple of minutes or so)

Then a few seconds before it restarted ok, I got this:

Quote
Connection Problems

Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.
Title: Re: Server Error Reports
Post by: kalel on December 04, 2017, 07:11:17 am
Quote
Error establishing a database connection

Just a few minutes ago
Title: Re: Server Error Reports
Post by: tautech on December 04, 2017, 10:02:02 pm
For few minutes 10.55am till ~10.59am (8.55 am Sydney time) 502's
Title: Re: Server Error Reports
Post by: jgalak on December 04, 2017, 10:02:55 pm
Just got an error message saying:

Code: [Select]
502 - Bad Gateway

We are having server side difficulties and are working to resolve these issues as fast as we can.

If you are able please report this error to this thread. But before posting please read the instructions carefully!

Thank you for your patience,
Dave & gnif

Seemed to last about 5 minutes.

Occurred on these URLs:

https://www.eevblog.com/forum/testgear/siglent-they-filed-a-'wrongful-trademark-claim'/325/ (https://www.eevblog.com/forum/testgear/siglent-they-filed-a-'wrongful-trademark-claim'/325/)
https://www.eevblog.com/forum/chat/website-error-reports/ (https://www.eevblog.com/forum/chat/website-error-reports/)

Connection from the US, Optimum ISP, Windows 7 64bit, Firefox 52.4.0 (32-bit).

Time: about 21:58 UTC, lasted less than 5 minutes before started working again.
Title: Re: Server Error Reports
Post by: xrunner on December 06, 2017, 11:19:50 pm
Several times today -

Quote
502 - Bad Gateway

We are having server side difficulties and are working to resolve these issues as fast as we can.

If you are able please report this error to this thread. But before posting please read the instructions carefully!

Thank you for your patience,
Dave & gnif
Title: Re: Server Error Reports
Post by: beanflying on December 07, 2017, 02:14:11 am
I have been getting persistent errors since joining up. I am assuming you have cleaned out the error logs on SMF? It doesn't like being large. So rather than been strictly a server issue it may also be a backend SMF issue contributing to the server load? There is also a few ways to then use the server log to debug any SMF issues.

Also I haven't found a thread related to forum setup ideas and while I understand this forum is bare bones SMF this Mod giving some simple up down navigation buttons is worth adding. I have used it in a couple of forum builds/rebuilds in the past. The Mod author is also good at keeping it updated to current versions too. https://custom.simplemachines.org/mods/index.php?mod=3433
Title: Re: Server Error Reports
Post by: kulla on December 07, 2017, 07:26:51 am
Got 502 from cloudflare right now.

Error 502 Ray ID: 3c95c0dc2b518613 • 2017-12-07 07:25:51 UTC
Bad gateway
Title: Re: Server Error Reports
Post by: PA0PBZ on December 08, 2017, 09:51:47 pm
Still occasionally running into the (I think) backup problem, but it's early today. Happened about 4 minutes ago (21:45 UTC), normally it happens around 10 minutes from now (22:00 UTC).

502 - Bad Gateway
We are having server side difficulties and are working to resolve these issues as fast as we can.

If you are able please report this error to this thread. But before posting please read the instructions carefully!

Title: Re: Server Error Reports
Post by: Yansi on December 28, 2017, 09:56:48 pm
Err 502  again on Dec 28, 2017,  around 21:45 UTC. Was in error for quite some minutes.
Accessing: https://www.eevblog.com/forum/unreadreplies/ (https://www.eevblog.com/forum/unreadreplies/)

(but from the quite often seen errors 502 I get here, I observed it is irrelevant of what browser, device or page. The server just spews E502 from time to time - or maybe quite often.)



Title: Re: Server Error Reports
Post by: ChrisLX200 on December 28, 2017, 10:03:24 pm
Same here - 502. Do you still want these reports?
Title: Re: Server Error Reports
Post by: Yansi on December 29, 2017, 09:51:27 pm
Err 502  yet again on Dec 29, 2017,  around 21:45 UTC. Was in error for quite some minutes.
Accessing: https://www.eevblog.com/forum/unreadreplies/ (https://www.eevblog.com/forum/unreadreplies/)

(but from the quite often seen errors 502 I get here, I observed it is irrelevant of what browser, device or page. The server just spews E502 from time to time - or maybe quite often.)

//It seems like I am repeating myself, but so is the error.
Title: Re: Server Error Reports
Post by: Mr. Scram on December 29, 2017, 09:53:23 pm
I just had a bunch of 502s, about 5-10 minutes ago, on all pages tried.
Title: Re: Server Error Reports
Post by: ez24 on December 29, 2017, 09:59:02 pm
What I just learned is to copy before Posting.   I worked 1/2 hour on a reply and lost it.  This is the second time in the last few days.  Seems this is becoming a regular thing.
Title: Re: Server Error Reports
Post by: Yansi on December 29, 2017, 10:00:23 pm
Yeah, I've already noticed, the E502 is repeated every day at least at 21:45 UTC.
Title: Re: Server Error Reports
Post by: tautech on December 30, 2017, 11:47:16 pm
~10.42am Sydney time. Any pages tried. Lasted less than 5 mins.

Sort of every other day there are 502's.
Title: Re: Server Error Reports
Post by: Mr. Scram on December 31, 2017, 12:11:06 am
~10.42am Sydney time. Any pages tried. Lasted less than 5 mins.

Sort of every other day there are 502's.
Same here.
Title: Re: Server Error Reports
Post by: Yansi on January 02, 2018, 09:50:15 pm
Today the same again. As regularly 21:45 UTC, the server goes bust for about 3-5 mins.
Title: Re: Server Error Reports
Post by: PA0PBZ on January 02, 2018, 10:34:42 pm
Today the same again. As regularly 21:45 UTC, the server goes bust for about 3-5 mins.

Yes, same here.
Title: Re: Server Error Reports
Post by: diynoise on January 13, 2018, 11:54:59 am
Bad gateway errors on the whole forum for 5-10 minutes (not sure how many exactly).

The time the error occurred as close to the second as possible: 11:40 UTC (~15 mins ago)
The browser you use: chrome
The URL of the page you were accessing: various threads including this one
please let us know what exactly you were doing that triggered the error: just browsing, no action
Title: Re: Server Error Reports
Post by: Yansi on January 13, 2018, 01:03:53 pm
Bad gateway errors on the whole forum for 5-10 minutes (not sure how many exactly).

The time the error occurred as close to the second as possible: 11:40 UTC (~15 mins ago)
The browser you use: chrome
The URL of the page you were accessing: various threads including this one
please let us know what exactly you were doing that triggered the error: just browsing, no action

11:43 UTC here.
Browser and URL doesn't matter.
Title: Re: Server Error Reports
Post by: Yansi on January 15, 2018, 09:42:36 pm
21:27 UTC again, short duration of 502 for a couple of minutes.
Title: Re: Server Error Reports
Post by: ez24 on January 15, 2018, 10:09:04 pm
I wish the admin would change the error message to something like:

"Routine Outage - Back within a couple of minutes"

The current error message throws me every time.
Title: Re: Server Error Reports
Post by: Yansi on January 17, 2018, 09:53:47 pm
Our favorite regular 21:45 UTC outage is here again.  ^-^
Title: Re: Server Error Reports
Post by: PA0PBZ on January 24, 2018, 09:41:20 pm
Our favorite regular 21:45 UTC outage is here again.  ^-^

21:35 UTC today, to make It a bit more exiting I guess....
Title: Re: Server Error Reports
Post by: ez24 on January 24, 2018, 09:55:22 pm
Our favorite regular 21:45 UTC outage is here again.  ^-^
This should be the error message  :-DD

I forgot (to copy) and lost a long post  |O
Title: Re: Server Error Reports
Post by: rhb on January 25, 2018, 02:42:32 pm
I just got the message.  Though this time I was able to get in.
Title: Re: Server Error Reports
Post by: Yansi on January 25, 2018, 03:22:08 pm
<< ez24: Just hit "back" in the browser to retrieve the text of the message.

Got the error right now, 15:20 UTC. Server becoming slow responding in the last hour.

Just got the error when tried to send this message too.
Title: Re: Server Error Reports
Post by: Magnificent Bastard on January 25, 2018, 05:07:08 pm
Got a 503 Bad Gateway when trying to go to this thread/message:

https://www.eevblog.com/forum/projects/has-anybody-built-their-own-mass-spectrometer-before/msg1409645/?topicseen#msg1409645 (https://www.eevblog.com/forum/projects/has-anybody-built-their-own-mass-spectrometer-before/msg1409645/?topicseen#msg1409645)

Other threads appear to be OK.

-MB
Title: Re: Server Error Reports
Post by: gnif on January 25, 2018, 05:12:57 pm
There was an incident of server overload, a script was hammering MySQL. I don't have time to look into it right now unfortunately, my office took a lightning strike that fed into an Ethernet cable... lots of dead Ethernet gear and NICs.

Correction The server was under a DDoS attack by a cluster of servers trying to overload the website by flooding posts to the search input. The attack has been blocked.
Title: Re: Server Error Reports
Post by: Yansi on January 31, 2018, 09:48:39 pm
Server seems to be overloaded and under ddos attack quite regularly. Every day. Just got the famous 21:45UTC gateway error again.
Title: Re: Server Error Reports
Post by: Muttley Snickers on February 24, 2018, 11:43:37 pm
Whilst returning to the main page today at 10:29 AEDT or 23:29 GMT I received a 502 bad gateway message, it only lasted for a minute or so then after a refresh returned to normal, it might have just been a backup or restart.
Title: Re: Server Error Reports
Post by: beanflying on February 25, 2018, 12:47:59 am
Been a bit flakey for the last couple of days. Maybe Batteroo's YouTube dislike campaign extends to ddos  :--
Title: Re: Server Error Reports
Post by: PA0PBZ on February 26, 2018, 09:41:51 pm
21:38 GMT: 502 bad gateway.
Title: Re: Server Error Reports
Post by: paulca on March 09, 2018, 09:46:20 pm
It seems to go dead for about 5 minutes almost every evening around 21:30 GMT.  Is it a windows server on a daily reboot or is the a backup that runs which takes the site off line?  Not complaining, just curious.
Title: Re: Server Error Reports
Post by: gnif on March 19, 2018, 02:46:23 am
I apologize for the outage that occurred during Dave's Live Stream just now. This server came under heavy DDoS attack from a range of addresses just as Dave started to attempt to perform the draw. This was not an inrush of viewers, I had to block 50 IP addresses, most running at over 100 requests/sec, a few of them over 200/sec, and one at over 1000/sec.

173.167.206.137 was the heavy hitter at 1000/sec.

We are behind CloudFlare which is supposed to block this kind of thing, but it just proxied it all through... what a Joke.
Title: Re: Server Error Reports
Post by: hermit on March 19, 2018, 03:12:10 am
A subset of Comcast.  Probably one of the business accounts.  I'm sure a complaint to Comcast will bring swift results.  ::)
Title: Re: Server Error Reports
Post by: bitseeker on March 19, 2018, 03:13:19 am
Yep, a static Comcast Business IP address.
Title: Re: Server Error Reports
Post by: gnif on March 19, 2018, 03:14:23 am
Comcast has been contacted. There is clearly a remote viewer sitting on that IP, looks very old and unmaintained, likely compromised.
Title: Re: Server Error Reports
Post by: gnif on April 01, 2018, 06:59:47 pm
Just a notice to everyone

There will be a short database outage in a few minutes so I can change a few settings in preparation of the server move.

This does not mean the new server's are ready, I simply need to make a change so I can keep them in sync during the testing phase.

Edit: Done
Title: Re: Server Error Reports
Post by: David Chamberlain on April 13, 2018, 09:37:32 pm
Around Friday, 13 April 2018 21:25:00 UTC
502 - Bad Gateway
https://www.eevblog.com/forum/projects/ (https://www.eevblog.com/forum/projects/)
https://www.eevblog.com/forum/ (https://www.eevblog.com/forum/)
Browser : Chrome 65 on Android.

Was like that when i checked for about that time and then came right after a few minutes.
Title: Re: Server Error Reports
Post by: JS on April 19, 2018, 09:30:09 pm
502

Trying to post a reply 2 minutes ago to this post

https://www.eevblog.com/forum/projects/help-with-usb-sound-card-oscilloscope-108256/ (https://www.eevblog.com/forum/projects/help-with-usb-sound-card-oscilloscope-108256/)

then again trying to get to this topic, from the error link.

I'm using saffari 11.0.2

JS
Title: Re: Server Error Reports
Post by: geekGee on April 28, 2018, 07:57:01 pm
At the time of this reply, I am getting a blank page with /forum/index.php containing URLs.  I've tried a few web browsers and wget is downloading a zero sized file.

I had to navigate to this topic using a link to another then used search.
Title: Re: Server Error Reports
Post by: PA0PBZ on April 28, 2018, 08:02:08 pm
Yes, something is seriously broken, most links just return a blank page  :--
Title: Re: Server Error Reports
Post by: ez24 on April 28, 2018, 08:33:41 pm
Yes, something is seriously broken, most links just return a blank page  :--

whew - I thought it was me  :-DD
Title: Re: Server Error Reports
Post by: StillTrying on April 28, 2018, 09:35:30 pm
I'm having to navigate using the small 'Jump to' drop down box.
Title: Re: Server Error Reports
Post by: ez24 on April 28, 2018, 10:26:15 pm
Here is the link that does not work for me, "Show unread posts since last visit." -->

https://www.eevblog.com/forum/unread/ (https://www.eevblog.com/forum/unread/)

Just returns a blank screen  ie no error messages
Title: Re: Server Error Reports
Post by: Mr. Scram on April 28, 2018, 10:39:28 pm
Here is the link that does not work for me, "Show unread posts since last visit." -->

https://www.eevblog.com/forum/unread/ (https://www.eevblog.com/forum/unread/)

Just returns a blank screen  ie no error messages
Funny, that's one of the ones that does work for me.
Title: Re: Server Error Reports
Post by: tautech on April 28, 2018, 10:43:47 pm
Here is the link that does not work for me, "Show unread posts since last visit." -->

https://www.eevblog.com/forum/unread/ (https://www.eevblog.com/forum/unread/)

Just returns a blank screen  ie no error messages
All working fine now here with Chrome.
ez, do a hard page refresh with F5.
Title: Re: Server Error Reports
Post by: richnormand on April 28, 2018, 10:48:22 pm
All I got hitting "forum" is a blank page. A hard reset page F5 did not do anything.
No timeout either it looked like the white blank page was the content...

Rebooted the computer and tried again: same thing.

Fine now.



Title: Re: Server Error Reports
Post by: tautech on April 28, 2018, 10:53:39 pm
All I got hitting "forum" is a blank page. A hard reset page F5 did not do anything.
No timeout either it looked like the white blank page was the content...

Rebooted the computer and tried again: same thing.

Fine now.
Crazy.  :-//

It was shite a couple of hours back here but seems to have come right for me.
Shut my PC down for a change last night but it was all problems here first thing. Anything with .php as mentioned before gave a blank white screen
Came right all by itself ~30 mins ago.
Title: Re: Server Error Reports
Post by: hermit on April 28, 2018, 11:22:42 pm
@gnif  I thought I'd wait it out.  Unread threads finally worked but only on the first page.  Hit next and got a blank screen.
Title: Re: Server Error Reports
Post by: edpalmer42 on April 28, 2018, 11:39:14 pm
Somebody's got to say it.....

Should we change servers???  >:D >:D >:D :-DD :horse:

Ed
Title: Re: Server Error Reports
Post by: AlfBaz on April 28, 2018, 11:40:12 pm
firefox here on windows, unread posts since last visit usually returns many pages, lately Im getting only 1 or two posts. At the same time on my phone however, I get the usual number of unread posts
Title: Re: Server Error Reports
Post by: AlfBaz on April 29, 2018, 01:48:32 am
Just fired up ff and the unread posts is full again :-//
Title: Re: Server Error Reports
Post by: Brumby on April 29, 2018, 03:12:53 am
I've been checking out a few things and found one that serves me a blank page...
https://www.eevblog.com/forum/dodgy-technology/ (https://www.eevblog.com/forum/dodgy-technology/)
I can get to the latest updated thread in that board, but not to the thread list.

I've checked this 3 or 4 times while browsing the forum - and it has not changed over all that time (about 2 hours, on and off).   https or http makes no difference.
Title: Re: Server Error Reports
Post by: amyk on April 29, 2018, 04:33:48 am
I've been checking out a few things and found one that serves me a blank page...
https://www.eevblog.com/forum/dodgy-technology/ (https://www.eevblog.com/forum/dodgy-technology/)
I can get to the latest updated thread in that board, but not to the thread list.

I've checked this 3 or 4 times while browsing the forum - and it has not changed over all that time (about 2 hours, on and off).   https or http makes no difference.
Same here, blank page but no indication of error from server (response is 200 OK, but there's no content.)
Title: Re: Server Error Reports
Post by: Cyberdragon on April 29, 2018, 06:12:02 am
The link to dodgy technology doesn't work for me.

Not that I really want it fixed. I'd never have noticed normally. But in the interests in getting everything sorted asap I can confirm I also get a blank page.

This appears to be the only thing still down, though I haven't tried absolutely everything.

I'll just have to post my rant in General. >:D
Title: Re: Server Error Reports
Post by: ModemHead on April 29, 2018, 01:36:18 pm
When I "show unread posts since last visit" I get 4 pages.  Pages 1-3 are fine but 4 (or hitting "Next" on page 3) serves me an empty page (status 200, 0 bytes) just like the rest of you are describing.  :-//
Title: Re: Server Error Reports
Post by: ModemHead on April 29, 2018, 02:02:24 pm
When I "show unread posts since last visit" I get 4 pages.  Pages 1-3 are fine but 4 (or hitting "Next" on page 3) serves me an empty page (status 200, 0 bytes) just like the rest of you are describing.  :-//

I haven't noticed that although I tend to click on the numbers in preference to clicking "next". So it appears to be working correctly to me. I'll check tomorrow when the unreads posts have had a chance to accumulate to 4 pages.
I thought I would fool it by going to page 3 of 4 and selecting and marking all the topics read so that the older stuff would move up.  Nope, last page is blank.  And now that I've gone through the 3 pages that I could see and marked them all as read, clicking "show unread posts since last visit" serves me a blank page.  Weird.
Title: Re: Server Error Reports
Post by: hermit on April 29, 2018, 04:26:51 pm
When I "show unread posts since last visit" I get 4 pages.  Pages 1-3 are fine but 4 (or hitting "Next" on page 3) serves me an empty page (status 200, 0 bytes) just like the rest of you are describing.  :-//
Same here.  I've felt that this 'feature' most of the time served up way too much in terms of how far back it went anyhow.  In this case page 5 would take me back past stuff that are easily outside the range of my last visit time.
Title: Re: Server Error Reports
Post by: 2N3055 on April 29, 2018, 05:39:53 pm
Last page is always blank.. So if you have only few items on first page it is also your last and you don't see it either.....
That is very recent, I noticed it today..

Title: Re: Server Error Reports
Post by: richnormand on April 29, 2018, 07:39:00 pm
As of this morning and later in the afternoon today. Two different computers.
This page shows as blank for me:
https://www.eevblog.com/forum/dodgy-technology/ (https://www.eevblog.com/forum/dodgy-technology/)

How ironic....
Rest of forum worked as expected....





Title: Re: Server Error Reports
Post by: jmelson on April 30, 2018, 02:28:02 am
The dodgy-technology main-level forum has been giving a blank page for about 24 hours.

Jon
Title: Re: Server Error Reports
Post by: hermit on April 30, 2018, 04:49:53 am
Unread posts has been working for me for the past few hours it seems.  Worked before I went for my run and worked when I got back.  No more blank page.
Title: Re: Server Error Reports
Post by: nugglix on April 30, 2018, 05:12:41 am
Same here in Europe.

Would really like to know what caused that weird behavior.
Title: Re: Server Error Reports
Post by: bitwelder on April 30, 2018, 01:39:02 pm
As of this morning and later in the afternoon today. Two different computers.
This page shows as blank for me:
https://www.eevblog.com/forum/dodgy-technology/ (https://www.eevblog.com/forum/dodgy-technology/)

How ironic....
Rest of forum worked as expected....
Same here.
Interesting that although I get a blank page if I try to access the dodgy-technology forum area,
I can correctly read the thread pointed by the 'Last post' for the same area, as indexed by the main EEVblog forum page

EDIT: and also access the other 'dodgy' threads via the 'previous' and 'next' buttons on the top and bottom right side
Title: Re: Server Error Reports
Post by: tautech on May 01, 2018, 07:55:03 am
Hi gnif
Search tab result problems (didn't try the text box)

Normal search, not Advanced search.
Search for : transformer winding

Scroll through P1
Hit Next or P2 and the page defaults to a Revise Search page, not the next page as one expects.
Similar results with the page menu at either top or bottom of page. Got the 2nd page once only but never a further page.

Chrome browser.
SMF bug or server bug ?
TIA.
Title: Re: Server Error Reports
Post by: xrunner on May 02, 2018, 12:16:21 pm
Hi gnif
Search tab result problems (didn't try the text box)

Normal search, not Advanced search.
Search for : transformer winding

Scroll through P1
Hit Next or P2 and the page defaults to a Revise Search page, not the next page as one expects.
Similar results with the page menu at either top or bottom of page. Got the 2nd page once only but never a further page.

FYI, tried it - Doesn't happen with FF.
Title: Re: Server Error Reports
Post by: clucas on May 03, 2018, 12:08:11 am
my apologies if this is in the wrong thread but when I click on the 'Dodgy Technology' thread, the page is blank. This has been happening for about a week or so. Is the thread still active?
Title: Re: Server Error Reports
Post by: basinstreetdesign on May 03, 2018, 12:32:27 am
The dodgy-technology main-level forum has been giving a blank page for about 24 hours.

Jon

Me too, still.
Title: Re: Server Error Reports
Post by: Brumby on May 03, 2018, 01:56:28 am
my apologies if this is in the wrong thread but when I click on the 'Dodgy Technology' thread, the page is blank. This has been happening for about a week or so. Is the thread still active?
The dodgy-technology main-level forum has been giving a blank page for about 24 hours.

Jon

Me too, still.

Yes.  It's a known problem.

The threads can still be accessed directly by going through a search, but we can't get the topic list up.
Title: Re: Server Error Reports
Post by: bitseeker on May 04, 2018, 05:44:48 am
Oh, the irony.
Title: Re: Server Error Reports
Post by: BravoV on May 04, 2018, 06:00:13 am
I access this forum through various places PCs, tablet,smartphone and notebook, before the upgrade, the forum remembered and maintain the exact list of unread posts or my subscribed threads at every devices I used.

Now, it lost it, I get different list on different devices.
Title: Re: Server Error Reports
Post by: Brumby on May 05, 2018, 08:44:25 am
my apologies if this is in the wrong thread but when I click on the 'Dodgy Technology' thread, the page is blank. This has been happening for about a week or so. Is the thread still active?

It's back.


I don't know if that's a good thing or not.....
Title: Re: Server Error Reports
Post by: gnif on May 05, 2018, 08:52:18 am
I fixed it, took a few hours of debugging. The seo friendly plugin doesn't support UTF-8 properly and was trying to insert a duplicated record into a table inside an output buffer callback, as such a white page was generated with no errors, nor debug logging of the fault.

The solution was to strip all non ASCII 7-bit character from SEO urls.
Title: Re: Server Error Reports
Post by: Towger on May 05, 2018, 09:16:03 am
On Tapatalk the form names are no longer displayed, only the descriptions.

(https://uploads.tapatalk-cdn.com/20180505/019f017e88385c0da225fa99177b2bcf.jpg)
Title: Re: Server Error Reports
Post by: gnif on May 05, 2018, 09:26:17 am
On Tapatalk the form names are no longer displayed, only the descriptions.

(https://uploads.tapatalk-cdn.com/20180505/019f017e88385c0da225fa99177b2bcf.jpg)

When did this start?
Title: Re: Server Error Reports
Post by: Towger on May 05, 2018, 09:28:29 am
Not sure, only noticed it today.
Title: Re: Server Error Reports
Post by: jmelson on May 07, 2018, 01:59:51 am
I fixed it, took a few hours of debugging. The seo friendly plugin doesn't support UTF-8 properly and was trying to insert a duplicated record into a table inside an output buffer callback, as such a white page was generated with no errors, nor debug logging of the fault.

The solution was to strip all non ASCII 7-bit character from SEO urls.
Wow, glad somebody understands all this php and SQL stuff.  I run a web store, and have a very rudimentary understanding of it, but just enough to be dangerous.

Thanks for fixing that forum/thread!

Jon
Title: Re: Server Error Reports
Post by: bitseeker on May 07, 2018, 07:02:36 am
I fixed it, took a few hours of debugging. The seo friendly plugin doesn't support UTF-8 properly and was trying to insert a duplicated record into a table inside an output buffer callback, as such a white page was generated with no errors, nor debug logging of the fault.

The solution was to strip all non ASCII 7-bit character from SEO urls.

Wow, not a sysadmin friendly plugin. Thanks for tracking that down and sorting it out, gnif.
Title: Re: Server Error Reports
Post by: richnormand on June 18, 2018, 10:41:19 pm
For some reason the main site and the forum are extremely slow with waits to close to half a minute to timeouts today. Test with other sites are all OK.
I go through the Toronto hub I think. Will try VPN to US site and see.
Title: Re: Server Error Reports
Post by: tautech on June 18, 2018, 10:41:38 pm
Not so much errors gnif but at times the forum is very slow to refresh, accept a post or just general viewing.
Might need a  :-/O somewhere.
Title: Re: Server Error Reports
Post by: gnif on June 18, 2018, 10:55:42 pm
There is currently an outage with one of the two servers, looks like a bad route which I am investigating.
Title: Re: Server Error Reports
Post by: gnif on June 18, 2018, 11:13:25 pm
There is currently an outage with one of the two servers, looks like a bad route which I am investigating.

Fixed, we are now back at full capacity. One of the servers had been null routed as a bug in SMF4M was being abused to proxy redirects to external websites.
The site became slow because both servers could still see and talk to each other, as such they had no way to determine that one had lost connectivity. Traffic had to timeout before it would be sent to the other server, so no outage, just slow.
Title: Re: Server Error Reports
Post by: EEVblog on June 19, 2018, 02:05:10 am
There is currently an outage with one of the two servers, looks like a bad route which I am investigating.

Fixed, we are now back at full capacity. One of the servers had been null routed as a bug in SMF4M was being abused to proxy redirects to external websites.
The site became slow because both servers could still see and talk to each other, as such they had no way to determine that one had lost connectivity. Traffic had to timeout before it would be sent to the other server, so no outage, just slow.

Thanks gnif
So that's a win already for the dual server redundancy. Albeit in the weird way made it slower than it otherwise wouldn't have been. But better slow than offline.
Title: Re: Server Error Reports
Post by: gnif on June 19, 2018, 02:10:16 am
There is currently an outage with one of the two servers, looks like a bad route which I am investigating.

Fixed, we are now back at full capacity. One of the servers had been null routed as a bug in SMF4M was being abused to proxy redirects to external websites.
The site became slow because both servers could still see and talk to each other, as such they had no way to determine that one had lost connectivity. Traffic had to timeout before it would be sent to the other server, so no outage, just slow.

Thanks gnif
So that's a win already for the dual server redundancy. Albeit in the weird way made it slower than it otherwise wouldn't have been. But better slow than offline.

Normally with a server outage the up server will see the other server is no longer responding and will take over it's duties, but because the data center had null routed the external traffic, the two servers could not see there was a fault condition. In what would be considered a normal outage there would be no visible performance impact on the hosting.
Title: Re: Server Error Reports
Post by: hermit on June 19, 2018, 02:17:07 am
I couldn't get through at all but when I went to an external site it showed some places getting through and others not.  Seemed to be no rhyme or reason to physical locations worldwide that connected and didn't so I just waited it out.
Title: Re: Server Error Reports
Post by: EEVblog on June 19, 2018, 02:38:49 am
Normally with a server outage the up server will see the other server is no longer responding and will take over it's duties, but because the data center had null routed the external traffic, the two servers could not see there was a fault condition. In what would be considered a normal outage there would be no visible performance impact on the hosting.

So in this case, out of curiosity what would have made it act "slower"?
Title: Re: Server Error Reports
Post by: gnif on June 19, 2018, 02:49:06 am
Normally with a server outage the up server will see the other server is no longer responding and will take over it's duties, but because the data center had null routed the external traffic, the two servers could not see there was a fault condition. In what would be considered a normal outage there would be no visible performance impact on the hosting.

So in this case, out of curiosity what would have made it act "slower"?

We have two IPv4 addresses listed in DNS for this website, both for load balancing and in the event something like what happened here occurs. In normal operation both IP addresses go to a single load balancer which then routes them to one of the two servers. During a fault the faulted server's IP address will be taken over by the still working server, allowing normal operation, but as stated above, this did not occur due to internal communication between servers still being fully functional.

The delay was because of this design, one IP address to the world was offline. Your browser is designed to try to contact each IP address listed in DNS, failure to contact one after a timeout (normally 30 seconds), it will try the next, it was this timeout that was causing the slow behavior. Just like when you try to go to a domain that is offline, there might be 30-60 seconds before the browser gives up.
Title: Re: Server Error Reports
Post by: tautech on June 25, 2018, 12:28:16 pm
Something's not right.  :-//
502's off and on for a couple of days and mainly in the evenings AU time, then this just a mo ago when trying to refresh the main forum page:

Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

Generally works fine after a couple of minutes and loads just as fast as normal.  :-//
Something needs your magic touch gnif.
Title: Re: Server Error Reports
Post by: gnif on June 25, 2018, 12:29:36 pm
It is already getting my magic touch :)

https://www.eevblog.com/forum/news/planned-server-maintenance-and-testing-2018-06-25/ (https://www.eevblog.com/forum/news/planned-server-maintenance-and-testing-2018-06-25/)
Title: Re: Server Error Reports
Post by: tautech on July 11, 2018, 03:19:07 am
gnif, a page that just won't load or any of the posts in it.  :-//
https://www.eevblog.com/forum/testgear/siglent-technical-support-join-in-eevblog/msg1663322/#new (https://www.eevblog.com/forum/testgear/siglent-technical-support-join-in-eevblog/msg1663322/#new)

That's page 43. The first page in the thread and others load just fine. I can see who's posted in the Test Equipment board and then check their posts to view it and then Reply from within that member posts page.
Seen this problem for a couple of hours at least now so ~midday Sydney time onwards.
TIA
Title: Re: Server Error Reports
Post by: gnif on July 11, 2018, 03:30:35 am
Thanks, I will look into it shortly, likely someone posted an image again that is dimensionally crazy large.
Title: Re: Server Error Reports
Post by: gnif on July 11, 2018, 04:33:09 am
gnif, a page that just won't load or any of the posts in it.  :-//
https://www.eevblog.com/forum/testgear/siglent-technical-support-join-in-eevblog/msg1663322/#new (https://www.eevblog.com/forum/testgear/siglent-technical-support-join-in-eevblog/msg1663322/#new)

That's page 43. The first page in the thread and others load just fine. I can see who's posted in the Test Equipment board and then check their posts to view it and then Reply from within that member posts page.
Seen this problem for a couple of hours at least now so ~midday Sydney time onwards.
TIA

This has been fixed (image removed), a Microsoft Bitmap was uploaded to the forum with a .png extension. SMF yet again crashed out due to it's inability to check mime types...  |O
Title: Re: Server Error Reports
Post by: tautech on July 16, 2018, 04:46:22 am
Hi gnif
Dunno if you can see it but the forum and EEVblog main page have been painfully slow to load and work with for the last few hours......like  :=\

All the other sites I'm using, no problem, quick as a flash !
Title: Re: Server Error Reports
Post by: Neilm on July 16, 2018, 06:55:59 pm
It is loading fine for me at the moment (7:55 BST)
Title: Re: Server Error Reports
Post by: gnif on July 18, 2018, 02:27:00 am
Logs over the last week show now issues with the hosting or slow load times, and my manual spot checks have not turned up any problems.

I find it amusing though, people now really notice if it's slow... when I started helping dave out, it was normal to be slow, and people only complained if it was down.
Title: Re: Server Error Reports
Post by: gnif on August 10, 2018, 01:26:43 pm
The short outage that just occurred was due to a connectivity failure at the data center.  EEVBlog and several other clients that host at the same data center were offline for this period. Nothing to be concerned about :)
Title: Re: Server Error Reports
Post by: billrabinowitz on January 06, 2019, 04:40:44 pm
keep getting an error message when I try to post a question
Title: Re: Server Error Reports
Post by: gnif on January 06, 2019, 05:15:34 pm
keep getting an error message when I try to post a question


Not much I can do if you don't report what the error message is.
Title: Re: Server Error Reports
Post by: Towger on January 12, 2019, 09:38:00 am
Hi gnif,

When using Tapatalk, for the last few weeks links to photos hosted on the form are appearing as broken links.
It appears to correspond to this Tapatalk issue: https://www.tapatalk.com/groups/tapatalksupport/photos-problem-t40891.html (https://www.tapatalk.com/groups/tapatalksupport/photos-problem-t40891.html)
Which they eventually think is caused by "We find the domain of your forum registered in Tapatalk is HTTP protocol. But the attachments were uploaded to the HTTPS domain."
We have been https for some time now, so this may be a red herring or has the hosting of attached files been recently changed on the server?

Thanks,
Towger.
Title: Re: Server Error Reports
Post by: Brumby on March 05, 2019, 03:06:02 am
500 Internal Server Error on Youtube videos.

Seems something has gone wrong around the SMF Youtube processor.  All Youtube videos I've checked (new and old) no longer work, despite the code being correct.
Title: Re: Server Error Reports
Post by: beanflying on March 05, 2019, 03:16:25 am
500 Internal Server Error on Youtube videos.

Seems something has gone wrong around the SMF Youtube processor.  All Youtube videos I've checked (new and old) no longer work, despite the code being correct.

Just checked the short Drone one I posted in the TEA thread earlier and it is fine. So  :-//
Title: Re: Server Error Reports
Post by: tautech on March 05, 2019, 03:52:19 am
500 Internal Server Error on Youtube videos.

Seems something has gone wrong around the SMF Youtube processor.  All Youtube videos I've checked (new and old) no longer work, despite the code being correct.

Just checked the short Drone one I posted in the TEA thread earlier and it is fine. So  :-//
Now they are fine but YT links were down when Brumby posted.
Title: Re: Server Error Reports
Post by: Brumby on March 05, 2019, 04:35:58 am
Yes, confirming all OK now.
Title: Re: Server Error Reports
Post by: technix on June 03, 2019, 08:43:00 pm
Bug report: login never works in the mobile site.

Symptom: when trying to log in in the mobile site, it always fails if the login period is set to forever.

Expected behavior: after putting in the correct login credentials, selecting “keep logged in” on the mobile login page and hitting the login button, the user should be logged in.

Observed behavior: Instead of logging the user in, the error message “The login session has timed out” appears and the user is not logged in.

Platform: iOS 12, iPhone 7 and iPad mini 5th generation.

Note: logging on the desktop site, then switch to the mobile site is a viable workaround, but it doesn’t work very well on small-screen devices like iPhone due to the font size.
Title: Re: Server Error Reports
Post by: gnif on August 10, 2019, 02:25:05 pm
Servers were just upgraded to PHP 7.2, please excuse the short outage that occurred during this.
Title: Re: Server Error Reports
Post by: PA0PBZ on August 10, 2019, 02:31:15 pm
It did also reset the "Show unread posts since last visit" pointer.
Title: Re: Server Error Reports
Post by: gnif on August 10, 2019, 02:32:21 pm
Yup, sorry about that, the session information was lost during the upgrade, which was unavoidable.
Title: Re: Server Error Reports
Post by: Mr. Scram on August 10, 2019, 02:44:42 pm
Servers were just upgraded to PHP 7.2, please excuse the short outage that occurred during this.
https://www.youtube.com/watch?v=T2DTsS7cmMw (https://www.youtube.com/watch?v=T2DTsS7cmMw)
Title: Re: Server Error Reports
Post by: gnif on September 18, 2019, 02:53:23 am
Sorry for the outage people, Dave installed a mod that broke things. Up and running again :)
Title: Re: Server Error Reports
Post by: Halcyon on September 18, 2019, 02:55:00 am
Sorry for the outage people, Dave installed a mod that broke things. Up and running again :)

Bloody Murphy Dave ;-)
Title: Re: Server Error Reports
Post by: EEVblog on September 18, 2019, 02:58:37 am
Sorry for the outage people, Dave installed a mod that broke things. Up and running again :)

Bloody Murphy Dave ;-)

I'll cop it!
Never had a mod take down the forum before, SMF has always played nice in that regard.
Title: Re: Server Error Reports
Post by: tautech on September 18, 2019, 04:55:07 am
Sorry for the outage people, Dave installed a mod that broke things. Up and running again :)

Bloody Murphy Dave ;-)

I'll cop it!
Never had a mod take down the forum before, SMF has always played nice in that regard.
Nice, you fixed the double flags !  :clap:
Title: Re: Server Error Reports
Post by: beanflying on September 18, 2019, 05:01:38 am
Sorry for the outage people, Dave installed a mod that broke things. Up and running again :)

Bloody Murphy Dave ;-)

I'll cop it!
Never had a mod take down the forum before, SMF has always played nice in that regard.

Generally not an issue but I was maintaining a hidden dummy forum to try mods and play with layouts before unleashing them on public forums. Might be worth it especially when SMF 2.1 'finally' gets released to try out any current mods and tweaks you have installed prior to upgrading the Forum proper.
Title: Re: Server Error Reports
Post by: gnif on September 18, 2019, 06:34:14 am
Running 'testing' forum of this size and complex configuration is a feat in itself. To accurately test how things will behave the configuration has to be near-identical, cluster configuration and all. That said when the next version is out of RC I plan to perform an install and test how the migration to it goes, I am dreading it however as I know that most (all?) mods/plugins will break.
Title: Re: Server Error Reports
Post by: beanflying on September 18, 2019, 06:54:12 am
Running 'testing' forum of this size and complex configuration is a feat in itself. To accurately test how things will behave the configuration has to be near-identical, cluster configuration and all. That said when the next version is out of RC I plan to perform an install and test how the migration to it goes, I am dreading it however as I know that most (all?) mods/plugins will break.

I am not right up to speed on where 2.1 is heading but the early on MODS not working from 2.0 to 2.1 is still the same by the sounds of it then. I do know a few of the mod devs had already made versions that were running on the Beta but still suspect. Even when it comes out might be worth hanging back to see if there is carnage on other forums first. Testing forum will never be perfect but it did save me when MOD's conflicted occasionally.
Title: Re: Server Error Reports
Post by: wilfred on September 18, 2019, 07:22:32 am
Running 'testing' forum of this size and complex configuration is a feat in itself. To accurately test how things will behave the configuration has to be near-identical, cluster configuration and all. That said when the next version is out of RC I plan to perform an install and test how the migration to it goes, I am dreading it however as I know that most (all?) mods/plugins will break.

A good reason to be sure you need a plugin before adding it.
Title: Re: Server Error Reports
Post by: BillB on October 15, 2019, 11:23:35 am
It seems there might be something wrong with this post.  Clicking on it returns a 504.  I wonder if someone posted an improper image or something? (It wasn't me this time)   

https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/ (https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/)

Title: Re: Server Error Reports
Post by: tautech on October 15, 2019, 11:27:18 am
It seems there might be something wrong with this post.  Clicking on it returns a 504.  I wonder if someone posted an improper image or something? (It wasn't me this time)   

https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/ (https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/)
Yep reported and also mentioned here:
https://www.eevblog.com/forum/blog/504-gateway-time-out-214220/ (https://www.eevblog.com/forum/blog/504-gateway-time-out-214220/)
Title: Re: Server Error Reports
Post by: gnif on October 15, 2019, 11:33:56 am
And as stated in the other thread, there is nothing I can do at current sorry as I am out of the country in an area with very poor internet connectivity. I will attend to it as soon as possible but no promises on when at this time.
Title: Re: Server Error Reports
Post by: BillB on October 15, 2019, 03:50:26 pm
And as stated in the other thread, there is nothing I can do at current sorry as I am out of the country in an area with very poor internet connectivity. I will attend to it as soon as possible but no promises on when at this time.

Sorry, I didn't see the other post.  I wasn't sure where to post a problem report.  Anyway, the thread in question opens just fine in IE or private Window Firefox, so it just has something to do with my FireFox plug-ins.
Title: Re: Server Error Reports
Post by: PA0PBZ on October 15, 2019, 04:25:18 pm
And as stated in the other thread, there is nothing I can do at current sorry as I am out of the country in an area with very poor internet connectivity. I will attend to it as soon as possible but no promises on when at this time.

Sorry, I didn't see the other post.  I wasn't sure where to post a problem report.  Anyway, the thread in question opens just fine in IE or private Window Firefox, so it just has something to do with my FireFox plug-ins.

It is about page 60: https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/1475/ (https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/1475/)

It doesn't open Chrome, Edge, IE or Firefox.
Title: Re: Server Error Reports
Post by: StillTrying on October 15, 2019, 09:43:32 pm
I think it should be possible to delete the post on P60, or its 3 attachments without getting to P60.

Post: https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/msg2736522/#msg2736522 (https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/msg2736522/#msg2736522)

Attachments:
https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/?action=dlattach;attach=854182 (https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/?action=dlattach;attach=854182)
https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/?action=dlattach;attach=854184 (https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/?action=dlattach;attach=854184)
https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/?action=dlattach;attach=854186 (https://www.eevblog.com/forum/testgear/siglent-sds1204x-e-released-for-domestic-markets-in-china/?action=dlattach;attach=854186)
Title: Re: Server Error Reports
Post by: McBryce on October 16, 2019, 07:46:56 am
I think the problem could be that the attachments are named *.PNG but are in fact BMP files?

McBryce.
Title: Re: Server Error Reports
Post by: BrianHG on November 07, 2019, 09:38:11 am
I found a bug with the 'Insert Code' feature.  Example:

Click just below the link 'select'.
Code: [Select]
module vid_pattern_generator(
input wire pclk,
input wire reset,
input wire pc_ena,      // Pixel clock enable
input wire hde_in, // Horizontal Display Enable - high when in display area (valid drawing area)
input wire vde_in, // Vertical Display Enable - high when in display area (valid drawing area)
input wire hs_in, // horizontal sync
input wire vs_in, // vertical sync


output reg hde_out,
output reg vde_out,
output reg hs_out,
output reg vs_out,

output reg [RGB_hbit:0] r_out,
output reg [RGB_hbit:0] g_out,
output reg [RGB_hbit:0] b_out,

);

parameter RGB_hbit    = 1;  // 1 will make the RGB ports go from 1 to 0, eg [1:0].  I know others prefer a '2' here for 2 bits


always @(posedge clk)
begin
if (reset) // global reset
begin



end
else
begin
if (pc_ena) // once per pixel
begin

// ***************  insert generator code here
// ***************  also remember to pass through the hde,vde,hs_out,vs_out
// ***************  in the future, numerous delay sizes may be needed if you are performing functions which take multiple clocks before a true pixel becomes valid

end
end
end // always @clk
endmodule

Just above, where I said 'Click on this code [select], the text in the code box should have been highlighted, or copied into my windows text clipboard where I should have been able to paste the ASCII text into my own text editor.  However, clicking on the '[select]' does nothing at all.

I'm using Firefox.
Title: Re: Server Error Reports
Post by: PA0PBZ on November 07, 2019, 10:27:17 am
I'm using Firefox.

I can confirm it doesn't work in Firefox but it works fine in Chrome, Edge and IE. Not sure if this is a server problem or a Firefox one.
Title: Re: Server Error Reports
Post by: BrianHG on November 07, 2019, 10:40:32 am
I'm using Firefox.

I can confirm it doesn't work in Firefox but it works fine in Chrome, Edge and IE. Not sure if this is a server problem or a Firefox one.

I just tried another community software engineering forum who has the same feature, using Firefox, and it works fine.  This forum must be using some special coding which isn't compatible with Firefox.

In Firefox on this forum, going over the code 'select' with my mouse shows a 'javascript:void(0)' at the bottom left of my browser.
On the third party forum, moving my mouse over their code 'select all' shows a valid https link.
Title: Re: Server Error Reports
Post by: Cerebus on November 07, 2019, 10:45:18 am
I'm using Firefox.

I can confirm it doesn't work in Firefox but it works fine in Chrome, Edge and IE. Not sure if this is a server problem or a Firefox one.

Tested in Firefox 70.0.1 (the very latest production version) and it fails. Doesn't in other browsers, as previously noted.

If you fire up the Firefox web console you see the following messages:

Quote
WARNING: cdn.mathjax.org has been retired. Check https://www.mathjax.org/cdn-shutting-down/ (https://www.mathjax.org/cdn-shutting-down/) for migration tips. MathJax.js:32:13
Loading failed for the <script> with source “https://ajax.googleapis.com/ajax/libs/jquery/1.12.4/jquery.min.js”. new:1:1
IndexSizeError: Index or size is negative or greater than the allowed amount 4 new:47
    smfSelectText https://www.eevblog.com/forum/chat/website-error-reports/new/?topicseen#new (https://www.eevblog.com/forum/chat/website-error-reports/new/?topicseen#new) line 5 > eval:47
    onclick https://www.eevblog.com/forum/chat/website-error-reports/new/?topicseen#new:1 (https://www.eevblog.com/forum/chat/website-error-reports/new/?topicseen#new:1)


So it looks like it's both Firefox and SMF in combination. Obviously it's the index error that's causing the problem and it's probably related to the failure to load ajax.googleapis.<snip>. Note that I can quite happily load the ajax.googleapis... javascript in a different Firefox window so something about SMF is causing it to fail to load.

That mathjax deprecation warning looks like it needs attending to as well.
Title: Re: Server Error Reports
Post by: gnif on December 25, 2019, 01:10:53 am
We are back, it seems somebody decided to attack the site on xmas day as we were the target of a distributed DDoS attack.

For those reporting bugs/problems with the forum, I am sorry but this thread is for server errors only, not forum bugs.
Title: Re: Server Error Reports
Post by: Koen on December 25, 2019, 06:07:52 pm
I now receive this popup from Chrome when I login :

"Change your password."
"A data breach on a site or app exposed your password. Chrome recommends changing your password on www.eevblog.com (http://www.eevblog.com) now."
Title: Re: Server Error Reports
Post by: Black Phoenix on December 26, 2019, 05:22:57 am
I now receive this popup from Chrome when I login :

"Change your password."
"A data breach on a site or app exposed your password. Chrome recommends changing your password on www.eevblog.com (http://www.eevblog.com) now."

Not on Firefox mind you, that also have the same functionality working.
Title: Re: Server Error Reports
Post by: bitseeker on March 27, 2020, 01:19:54 am
We're getting database errors when posting. Nothing happens when I get the error, but I saw one case where a post went through despite showing the error page.
Title: Re: Server Error Reports
Post by: bitseeker on April 04, 2020, 07:02:43 pm
Still getting a DB error, e.g., when modifying and then trying to save the original post of the TEA thread: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg1114480/ (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg1114480/)
Title: Re: Server Error Reports
Post by: Monkeh on April 20, 2020, 04:59:05 am
Starting around 04:50 UTC this morning, load times in the tens of seconds to minutes with sporadic 502s. Maybe it's just one of the small children playing with a toy ion cannon again.
Title: Re: Server Error Reports
Post by: orbanp on May 24, 2020, 01:37:56 pm
Post formatting error
Whenever I post new lines are randomly left out from my posting.Makes the posting all jumbled up.This is the only forum I am encountering this problem.I am using Firefox 76.0.1 (64-bit) on Ubuntu 18.04 with KDE front end.Just look at this posting!
Peter
Title: Re: Server Error Reports
Post by: beanflying on June 24, 2020, 09:12:43 pm
Apart from last nights outage and Server issues there is another problem that reared it's head yesterday.

Broken thumbnails not linking correctly to the picture that was uploaded. I 'fixed' one post by removing and replacing the files in the TEA thread but I have left this one https://www.eevblog.com/forum/chat/3d-printer-yet/msg3103687/#msg3103687 (https://www.eevblog.com/forum/chat/3d-printer-yet/msg3103687/#msg3103687) broken for a look.

The thing in common with the breakage is there is a space in the file name.

The edit and new post screen appears different in the attachment area as of yesterday so was there a new MOD installed yesterday or a different version of one installed? I suspect there is now a conflict with one of the file upload ones installed.
Title: Re: Server Error Reports
Post by: gnif on June 25, 2020, 01:24:41 am
Apart from last nights outage and Server issues there is another problem that reared it's head yesterday.

Broken thumbnails not linking correctly to the picture that was uploaded. I 'fixed' one post by removing and replacing the files in the TEA thread but I have left this one https://www.eevblog.com/forum/chat/3d-printer-yet/msg3103687/#msg3103687 (https://www.eevblog.com/forum/chat/3d-printer-yet/msg3103687/#msg3103687) broken for a look.

The thing in common with the breakage is there is a space in the file name.

The edit and new post screen appears different in the attachment area as of yesterday so was there a new MOD installed yesterday or a different version of one installed? I suspect there is now a conflict with one of the file upload ones installed.

This should be resolved as it was part of last nights efforts and I have regenerated the thumbnail in question.
Title: Re: Server Error Reports
Post by: gnif on June 25, 2020, 01:48:32 am
I have forced the server to re-generate all thumbnails going as far back as the initial report of the issue (15th June). Please report if this happens again.
Title: Re: Server Error Reports
Post by: mnementh on June 25, 2020, 04:14:07 am
It has happened here just a little while ago - https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3104394/#msg3104394 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3104394/#msg3104394)

The pic of a small speaker titled 1-Taming the Speaker.jpg now has the thumb from and seems to point to a pic from a later post; mnem-mask.jpg.


And here as well, recently; last time I was on thread this post was correct as well: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3103998/#msg3103998 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3103998/#msg3103998)

The image bean's Post.png SHOULD be a screencap of a TEA thread post by beanflying; that image now has the thumb from and seems to point to the battery image from the above post.

I usually use Firefox on my PCs; I brought up the thread on my iPad/Firefox and still FUBAR the same way, so not a local cache issue. Same behavior in Edge.
 

This may be related to another bug that has been happening for months; when posting multiple images, IF the posting process is interrupted for a new post warning, the damned thing just forgets the first pic. It attaches the rest of the pics normally, but that first one you ALWAYS have to go back and attach again.

As you can see, most of my pics in that post have spaces in the title; however the only one it barfed up was the first one, which I had re-uploaded because of the other bug. :-//

Let me know when you're done reviewing those posts and if you need I'll go back and re-attach the correct images.

Thanks,

mnem
Déjà vu: Best enjoyed as a garnish with wine, cheese and baguettes.

Title: Re: Server Error Reports
Post by: gnif on June 25, 2020, 04:34:14 am
SMF doesn't care about the filename, it stores all attachments as a hash of the file contents and references them via a table. There are two possible reasons why this happened:

1) The bug you mentioned
2) The maintenance last night was intended to correct some sync issues between the web servers as the database cluster had lost sync. Normally this would be fine, but there were other factors at play at the same time that prevented them from determining who was the "latest" and both were accepting update/insert queries at the same time (split-brain).

I should have been clearer I am sorry, if this is seen on new posts as of today, please let me know. Feel free to fix any that are messed up from prior.
Title: Re: Server Error Reports
Post by: Muttley Snickers on June 25, 2020, 06:09:28 am
Did something change today with the forum compatibility settings ? All the other sites are fine but I can no longer access the forum from my TV in the bedroom which runs an old crappy version of Chrome 22. I have reset everything my end but still get an Error 113 as shown in the image below. This message was posted from my main PC in the study.
Title: Re: Server Error Reports
Post by: gnif on June 25, 2020, 06:09:43 am
System updates were applied which may have removed deprecated & insecure SSL cryptos.
Title: Re: Server Error Reports
Post by: Muttley Snickers on June 25, 2020, 06:11:31 am
System updates were applied which may have removed deprecated & insecure SSL cryptos.
Bugger.   :palm:
Title: Re: Server Error Reports
Post by: gnif on June 25, 2020, 06:14:21 am
The people demanded SSL, they got it, people then demanded SSL enforcement, and in the end, they got it...
Welcome to the "modern" world :P

And I am sure you understand that there is no way I am going to maintain a custom version of OpenSSL/Nginx, etc... just to re-enable old crypto algs. Sorry.
Title: Re: Server Error Reports
Post by: Muttley Snickers on June 25, 2020, 06:21:56 am
No need to apologise, I am well overdue to update the TV as some other sites are not working anymore either. A friend gave me a Stick PC to resolve these issues but that gadget has been more trouble than it's worth.   :( 

https://www.eevblog.com/forum/chat/youtube-videos-no-longer-work-in-my-browser/ (https://www.eevblog.com/forum/chat/youtube-videos-no-longer-work-in-my-browser/)
Title: Re: Server Error Reports
Post by: gnif on June 25, 2020, 06:27:04 am
I recommend a RPi2 or better with LibreELEC on it.

https://libreelec.tv/

There is a Youtube addon, and even a EEVBlog one IIRC.
Title: Re: Server Error Reports
Post by: mnementh on June 25, 2020, 04:04:40 pm
An alternative is FF on a FireTV. I picked up one of the older brick-style ones cheap; it's powerful enough (Quad-core, 2GB RAM, MIMO) even today, and it still supports up to 2K native streaming with all the PrimeVideo (of course) and Netflix-certified HD content working correctly (Widevine DRM, etc) and Amazon still keeps them updated.  :-+

But the big plus is that even if you DON'T root & flash (you would NEVER do that, right...?  >:D), they have the ExpressVPN client available in the Amazon App store. For me, this makes it possible to keep watching my Hulu, etc while "visiting" in the Great White North... your reasons for wanting a VPN would be none of my business.  ;)

mnem
 :-/O
Title: Re: Server Error Reports
Post by: mnementh on June 26, 2020, 06:16:17 am
Happened again this afternoon. Had a post fail for new post warning; reposted seemed OK. Came back in the evening and it had gone blooey. I fixed it; not sure if you can follow the event history, but this is the post: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3105850/#msg3105850 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3105850/#msg3105850)

Cheers,

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: SilverSolder on June 26, 2020, 12:32:01 pm
The people demanded SSL, they got it, people then demanded SSL enforcement, and in the end, they got it...
Welcome to the "modern" world :P

And I am sure you understand that there is no way I am going to maintain a custom version of OpenSSL/Nginx, etc... just to re-enable old crypto algs. Sorry.

I swear I spend half the day on complying with various security features on the systems I work with.   Overall, the cost is probably higher than the inconvenience of just disconnecting those systems from the Internet altogether...
Title: Re: Server Error Reports
Post by: mnementh on June 26, 2020, 03:48:42 pm
Oklay... now it seems to be getting personal. Same post: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3105850/#msg3105850 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3105850/#msg3105850,); was fine last night after I fixed it, only now it's borked with a pic I just put up this AM in another thread.  |O

Should have this pic, not the screencap of a spacer that's there now:   (https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1010726;image)

Lets see if this one goes blooey next time I post something with a pic...  :-\

Title: Re: Server Error Reports
Post by: gnif on June 26, 2020, 03:51:56 pm
Thanks yeah, don't fix this one if it breaks again. Each time you "fix" them I have zero information to go on.
Title: Re: Server Error Reports
Post by: mnementh on June 26, 2020, 04:06:17 pm
Okay... no prob. Here's the post I just put up with the pic that seems to be going wherever it feels like: https://www.eevblog.com/forum/chat/3d-printer-yet/msg3106712/#msg3106712 (https://www.eevblog.com/forum/chat/3d-printer-yet/msg3106712/#msg3106712)

So far, these are the borked posts:

https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3105850/#msg3105850 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3105850/#msg3105850) <-- repeat borkee

https://www.eevblog.com/forum/chat/3d-printer-yet/msg3106050/#msg3106050 (https://www.eevblog.com/forum/chat/3d-printer-yet/msg3106050/#msg3106050) <-- newly borked

I went back a few pages before the repeat borkee post and everything there seems to be okay; but there were several posts I fixed before as well so no idea if they'll decide to get in on the fun next time I post a pic. :-//

mnem
Sorry to be so much hassle...  :palm:
Title: Re: Server Error Reports
Post by: mnementh on June 26, 2020, 04:26:01 pm
Oh, duh... should I wait until you have a chance to investigate the above borked posts to post more pics, or just go on about my business now so you can see any new trail of breadcrumbs?

mnem
(https://filedn.com/lEDSGUXnO7mp9lWR3BbARrR/Emoticons/coffee_L.gif)
Title: Re: Server Error Reports
Post by: mnementh on June 27, 2020, 02:42:48 am
Oklay... just happened again. Seems to be like... every time I post a pic, it borks one or more of my previous pics.  :wtf:

Lets see...

(http://)

mnem
 |O
Title: Re: Server Error Reports
Post by: mnementh on June 27, 2020, 02:44:20 am
Huh...?

(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1011142;image)

mnem
 |O
Title: Re: Server Error Reports
Post by: gnif on June 27, 2020, 02:49:16 am
I have managed to replicate this, it seems to be caused when you try to post the message before the attachment has finished uploading, or you cancel an attachment and then upload another. Still trying to nut down the exact sequence of events that cause it.
Title: Re: Server Error Reports
Post by: mnementh on June 27, 2020, 02:56:58 am
That last one was a .heic that I forgot to convert to .jpg . Of course... like we needed to add more confusion.

No, usually the progress bar completes like in half a sec; I may or may not see a thumb right then. Usually if I don't, it's because HEIC or some similar invalid filetype. I HAVE occasionally had it error out with something to the effect of "File too large or took too long to upload", even when I was only uploading a single pic like 1-1.5MB...?

Not in the last couple days, tho.  :-//

mnem
 :o
Title: Re: Server Error Reports
Post by: mnementh on June 27, 2020, 03:04:29 am
It seems to be behaving in here... for the moment.  ::)

However, this post: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3107484/#msg3107484 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3107484/#msg3107484)

I added a 3rd pic after posting; 14-Manufacturer Info.jpg. It IMMEDIATELY showed up in place of the first pic in that post.

Then, just to see if it would happen again, I made another post. Then cyborg.jpg replaced both instances of that pic.  :-//

mnem
 :-[
Title: Re: Server Error Reports
Post by: mnementh on June 27, 2020, 05:06:11 pm
(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1011596;image)

Seriously...? STILL behaving in here...? I've had to fix this damned pic like 6 times now in the TEA thread...  |O

mnem
Title: Re: Server Error Reports
Post by: gnif on June 28, 2020, 05:52:03 am
I am sorry, I have had limited time of late and have not yet had an opportunity to dig any deeper into this.

There have been other higher priority issues to resolve before looking at this issue, I have spent the last few days working to get backups working after server updates, finally succeeded. Doing a remote incremental backup of the SMF attachment directory consisting of over half a million files (around 60GB) internationally is a nightmare. We are using GlusterFS which limits options with how to do this backup, otherwise, I would just mount an image over the attachment directory and snapshot its backing storage each time. (tar/gz of the directory is not an acceptable option due to server load concerns)
Title: Re: Server Error Reports
Post by: mnementh on June 28, 2020, 04:01:43 pm
Oh, man... I'm so sorry.  :-[

I didn't mean to make it sound like I was unhappy with your work; I wouldn't have your job for all the money in the world. ;) I would literally rather work HellDesk in a borg cubicle ship again.  :-DD

No, I was grousing about Murphy being a little skank; REFUSING to propagate the fault in here, where it would be easy for you to see.  :P

Carry on, sir. We all know (at least everyone I hang out with) that you're doing the best you can with limited resources.

Oh, and thanks for all the hard work. Don't think we haven't noticed you monitoring the TEA thread at 2am; we grok the dedication therein.  :-+

mnem
 :clap:
Title: Re: Server Error Reports
Post by: StillTrying on July 01, 2020, 12:04:10 pm
I've seen users posted images or attachments change after few hours to a different one from the same poster.

For me what should be  rigoltime.png
https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/?action=dlattach;attach=1006307 (https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/?action=dlattach;attach=1006307)
https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/msg3103617/#msg3103617 (https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/msg3103617/#msg3103617)

loads as xy.png  which is here
www.eevblog.com/forum/beginners/what-an-oscilloscope-recommended-for-a-woman-passionate-about-electronics/?action=dlattach;attach=1013970 (https://www.eevblog.com/forum/beginners/what-an-oscilloscope-recommended-for-a-woman-passionate-about-electronics/?action=dlattach;attach=1013970)
https://www.eevblog.com/forum/beginners/what-an-oscilloscope-recommended-for-a-woman-passionate-about-electronics/msg3113248/#msg3113248 (https://www.eevblog.com/forum/beginners/what-an-oscilloscope-recommended-for-a-woman-passionate-about-electronics/msg3113248/#msg3113248)

 :scared:
Title: Re: Server Error Reports
Post by: rhb on July 01, 2020, 01:53:41 pm
I tried to post 3 photos, some quoted text and a comment a little while ago.   When I hit "post" I got an "upload files" dialog and when I clicked OK it simply hung.  An attempt to post from another browser tab led to it getting posted missing my comments and 2 of 3 photos.  I had a similar experience about a week ago shortly after which the forum became inaccessible for several hours.

Reg
Title: Re: Server Error Reports
Post by: DrG on July 01, 2020, 02:04:43 pm
Regarding the mysterious picture adds/replacements. I caught this problem in mid post that might give some clues to what is going on....

I am entering in a new post. I add a picture. In this case it is a picture of a mushroom in a photography focus stacking thread. I do the usual and add the pic, the post has not been sent.

In another window, I then scrolled through my old posts to find one that I intended to link into the post that is still open.

My eye caught that the pic of the mushroom had been substituted for a post of a graph in a corona virus thread - literally added to the post and when viewing the post, I can see that it was added and I could also see a notice:

There are attachments found, which you have attached before but not posted. These attachments are now attached to this post. If you do not want to include them in this post, you can remove them here.

So leaving an unattached photo (as when you are writing but have not submitted a post) is fair game to be inserted into any of ones posts that you view (not modify). Sounds nutty, but it looks like that is what just happened. I will complete the post and edit this message to see if it changes.

EDIT: as you can see, the pic in "limbo" got attached to this post. I did not add it to this post as per normal. Now that I know, I will be sure to have all my pics for a post lined up before opening any other windows or doing any other actions.

EDIT: I also see that the mushroom pic remained added to the corona virus post and bumped the original pic. I had to 'hand' correct that.

EDIT: and further, while the thumbnail pic attached to this post is the mushroom, the pic after the thumbnail is clicked, is the graph from the corona virus thread that I had to replace. I will log off hopefully clear the cache du jour and see if there is persistence....logging off/on makes no difference.

Pics in limbo are evil and get put in places that you don't want. Orphaning pics is the devils work  :)
Title: Re: Server Error Reports
Post by: rhb on July 01, 2020, 11:43:30 pm
Why is the quoting in this wrong?

https://www.eevblog.com/forum/testgear/scope-wars/msg3115270/#msg3115270 (https://www.eevblog.com/forum/testgear/scope-wars/msg3115270/#msg3115270)

My response is not nested correctly.

Reg
Title: Re: Server Error Reports
Post by: nuclearcat on July 02, 2020, 12:01:52 am
I am sorry, I have had limited time of late and have not yet had an opportunity to dig any deeper into this.

There have been other higher priority issues to resolve before looking at this issue, I have spent the last few days working to get backups working after server updates, finally succeeded. Doing a remote incremental backup of the SMF attachment directory consisting of over half a million files (around 60GB) internationally is a nightmare. We are using GlusterFS which limits options with how to do this backup, otherwise, I would just mount an image over the attachment directory and snapshot its backing storage each time. (tar/gz of the directory is not an acceptable option due to server load concerns)
Maybe restic + minio duo?
Also you can try "nice -n 19 ionice -c 3" before tar.
Title: Re: Server Error Reports
Post by: xrunner on July 02, 2020, 12:05:50 am
Why is the quoting in this wrong?

https://www.eevblog.com/forum/testgear/scope-wars/msg3115270/#msg3115270 (https://www.eevblog.com/forum/testgear/scope-wars/msg3115270/#msg3115270)

My response is not nested correctly.

Reg

Because some of the quote tags were in the wrong place, I edited it, is this what you wanted?

Code: [Select]

[quote author=gf link=topic=244895.msg3115242#msg3115242 date=1593644906]
[quote author=rhb link=topic=244895.msg3115206#msg3115206 date=1593643321]
Why do you have the 20 MHz BW filter turned on for this? 
[/quote]

Sorry, the [b]AWG[/b] isn't faster :(

[quote]
A 1024 point FFT with a 1 ns sample interval has a 500 MHz Nyquist and 977 kHz RBW.  With a 1024 pixel wide screen *every* sample can be shown. There is no interpolation needed.
[/quote]

Timebase is 20ns/div => ~1000 pixel = 200 ns, plus some headroom for zoom-in after stopping the capture. In the time domain display of the first image (-> step interpolation) you can see that the 1ns samples from the ADC are more than one pixel wide.

I'm pretty confident that the reported 12.5Gs/s FFT sampling rate is indeed the (upsampled) display buffer sampling rate for the selected timebase. Particularly in the first image, the spectrum beyond 1GHz matches the expected spectrum of the step-interpolation as shown in the time-domain trace.
[/quote]
Please put a 50 ohm thru termination on it and repost.  A BNC tee with a 50 ohm terminator is "good enough".  I'll address the rest later.  Interpolation does *not* imply greater BW.  Common knowledge if you resample via Fourier transform as I usually do.

Reg


gives this -


Why do you have the 20 MHz BW filter turned on for this? 

Sorry, the AWG isn't faster :(

Quote
A 1024 point FFT with a 1 ns sample interval has a 500 MHz Nyquist and 977 kHz RBW.  With a 1024 pixel wide screen *every* sample can be shown. There is no interpolation needed.

Timebase is 20ns/div => ~1000 pixel = 200 ns, plus some headroom for zoom-in after stopping the capture. In the time domain display of the first image (-> step interpolation) you can see that the 1ns samples from the ADC are more than one pixel wide.

I'm pretty confident that the reported 12.5Gs/s FFT sampling rate is indeed the (upsampled) display buffer sampling rate for the selected timebase. Particularly in the first image, the spectrum beyond 1GHz matches the expected spectrum of the step-interpolation as shown in the time-domain trace.
Please put a 50 ohm thru termination on it and repost.  A BNC tee with a 50 ohm terminator is "good enough".  I'll address the rest later.  Interpolation does *not* imply greater BW.  Common knowledge if you resample via Fourier transform as I usually do.

Reg
Title: Re: Server Error Reports
Post by: tooki on July 04, 2020, 12:10:14 pm
Regarding the mysterious picture adds/replacements. I caught this problem in mid post that might give some clues to what is going on....

I am entering in a new post. I add a picture. In this case it is a picture of a mushroom in a photography focus stacking thread. I do the usual and add the pic, the post has not been sent.

In another window, I then scrolled through my old posts to find one that I intended to link into the post that is still open.

My eye caught that the pic of the mushroom had been substituted for a post of a graph in a corona virus thread - literally added to the post and when viewing the post, I can see that it was added and I could also see a notice:

There are attachments found, which you have attached before but not posted. These attachments are now attached to this post. If you do not want to include them in this post, you can remove them here.

So leaving an unattached photo (as when you are writing but have not submitted a post) is fair game to be inserted into any of ones posts that you view (not modify). Sounds nutty, but it looks like that is what just happened. I will complete the post and edit this message to see if it changes.

EDIT: as you can see, the pic in "limbo" got attached to this post. I did not add it to this post as per normal. Now that I know, I will be sure to have all my pics for a post lined up before opening any other windows or doing any other actions.

EDIT: I also see that the mushroom pic remained added to the corona virus post and bumped the original pic. I had to 'hand' correct that.

EDIT: and further, while the thumbnail pic attached to this post is the mushroom, the pic after the thumbnail is clicked, is the graph from the corona virus thread that I had to replace. I will log off hopefully clear the cache du jour and see if there is persistence....logging off/on makes no difference.

Pics in limbo are evil and get put in places that you don't want. Orphaning pics is the devils work  :)
And now it's some other image, a still capture from a newscast. This problem is getting worse, it looks like to me.

I've encountered it here, among others:

https://www.eevblog.com/forum/chat/moisture-and-electronics/ (https://www.eevblog.com/forum/chat/moisture-and-electronics/)
https://www.eevblog.com/forum/repair/restore-dirtycorroded-ic-pins/ (https://www.eevblog.com/forum/repair/restore-dirtycorroded-ic-pins/)
Title: Re: Server Error Reports
Post by: DrG on July 04, 2020, 01:53:05 pm
Regarding the mysterious picture adds/replacements. I caught this problem in mid post that might give some clues to what is going on....

I am entering in a new post. I add a picture. In this case it is a picture of a mushroom in a photography focus stacking thread. I do the usual and add the pic, the post has not been sent.

In another window, I then scrolled through my old posts to find one that I intended to link into the post that is still open.

My eye caught that the pic of the mushroom had been substituted for a post of a graph in a corona virus thread - literally added to the post and when viewing the post, I can see that it was added and I could also see a notice:

There are attachments found, which you have attached before but not posted. These attachments are now attached to this post. If you do not want to include them in this post, you can remove them here.

So leaving an unattached photo (as when you are writing but have not submitted a post) is fair game to be inserted into any of ones posts that you view (not modify). Sounds nutty, but it looks like that is what just happened. I will complete the post and edit this message to see if it changes.

EDIT: as you can see, the pic in "limbo" got attached to this post. I did not add it to this post as per normal. Now that I know, I will be sure to have all my pics for a post lined up before opening any other windows or doing any other actions.

EDIT: I also see that the mushroom pic remained added to the corona virus post and bumped the original pic. I had to 'hand' correct that.

EDIT: and further, while the thumbnail pic attached to this post is the mushroom, the pic after the thumbnail is clicked, is the graph from the corona virus thread that I had to replace. I will log off hopefully clear the cache du jour and see if there is persistence....logging off/on makes no difference.

Pics in limbo are evil and get put in places that you don't want. Orphaning pics is the devils work  :)
And now it's some other image, a still capture from a newscast. This problem is getting worse, it looks like to me.

I've encountered it here, among others:

https://www.eevblog.com/forum/chat/moisture-and-electronics/ (https://www.eevblog.com/forum/chat/moisture-and-electronics/)
https://www.eevblog.com/forum/repair/restore-dirtycorroded-ic-pins/ (https://www.eevblog.com/forum/repair/restore-dirtycorroded-ic-pins/)

Wow, you are right. The pic displayed (the one you referred to as from a news cast) was the last pic that I attached to a post and it was attached to a post after making the original post in the this thread.

I wonder if my original post in this thread (the mushroom thumbnail but varying pic when you click it) will pic up the last pic link that I use. Testing it with this pic:

[attachimg=1]

Edit: well, so far it (the mushroom thumbnail in my original post in the thread) has NOT picked up the squirrel post above - it still clicks to the newspost pic. Odd.
Title: Re: Server Error Reports
Post by: StillTrying on July 04, 2020, 02:13:22 pm
I've seen users posted images or attachments change after few hours to a different one from the same poster.

My rigoltime.png on here loads as xy.png
https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/msg3103617/#msg3103617 (https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/msg3103617/#msg3103617)

I've removed and re-added rigoltime.png. :)

Ed But it changed again. :D
Title: Re: Server Error Reports
Post by: rhb on July 04, 2020, 03:33:44 pm
I just posted 3 photos.  The first one was munged.  When I tried to fix it I got a time out error.  I did not open any other EEVblog post.

Edit: Here's the post:

https://www.eevblog.com/forum/testgear/scope-wars/msg3119276/#msg3119276 (https://www.eevblog.com/forum/testgear/scope-wars/msg3119276/#msg3119276)
Title: Re: Server Error Reports
Post by: StillTrying on July 04, 2020, 08:50:25 pm
Here's another post where the thumbnails expand to the wrong image.

https://www.eevblog.com/forum/beginners/critique-my-first-pcb-design/msg3114552/#msg3114552 (https://www.eevblog.com/forum/beginners/critique-my-first-pcb-design/msg3114552/#msg3114552)
Title: Re: Server Error Reports
Post by: SilverSolder on July 05, 2020, 03:51:38 am

I've noticed that when attaching 2 or 3 images in-line, full size, the order of the attachments is not always respected...  I then have to edit the post and change the AttachImage tags to make it work...
Title: Re: Server Error Reports
Post by: StillTrying on July 05, 2020, 01:03:51 pm
"I've noticed that when attaching 2 or 3 images in-line, full size, the order of the attachments is not always respected..."

I used to add the attachments in reverse order.
I used to add the attachments in the correct order one by one, "modifying" the post after posting to add attachment 2.

None of them are 100%, it seems worse now where a thumbnail doesn't open the correct image - as well. :horse:
Title: Re: Server Error Reports
Post by: mnementh on July 05, 2020, 03:57:26 pm
Good to know it's not just me... I thought I had somehow personally offended the Forum Gods.  :-DD

Good Hunting, gnif. Hope you get it sorted soon. :-+

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: tooki on July 06, 2020, 04:06:31 pm

I've noticed that when attaching 2 or 3 images in-line, full size, the order of the attachments is not always respected...  I then have to edit the post and change the AttachImage tags to make it work...
Yep, that's an unrelated problem discovered immediately when the two image attachment plugins were added. There are no plans to fix it. :/
Title: Re: Server Error Reports
Post by: Gyro on July 06, 2020, 05:35:07 pm
Good to know it's not just me... I thought I had somehow personally offended the Forum Gods.  :-DD

Good Hunting, gnif. Hope you get it sorted soon. :-+

mnem
 :popcorn:

Here's a single image post example from today if it helps... https://www.eevblog.com/forum/projects/source-for-these-beefy-pancake-coils/ (https://www.eevblog.com/forum/projects/source-for-these-beefy-pancake-coils/)
Title: Re: Server Error Reports
Post by: tautech on July 06, 2020, 09:46:04 pm
Good to know it's not just me... I thought I had somehow personally offended the Forum Gods.  :-DD

Good Hunting, gnif. Hope you get it sorted soon. :-+

mnem
 :popcorn:
Nope it ain't just you mnem as the forum has some serious issues with attachment of files.
For now it's only safe to attach one/post.  ::)
Title: Re: Server Error Reports
Post by: T3sl4co1l on July 06, 2020, 10:17:12 pm
Different people are reporting different things, maybe a database or cache coherency issue?  Seems related to the relatively recent attachment upgrade, but I wonder why it didn't show up as a problem before; if the caches just weren't filled up until recently, that could hint at something?

Tim
Title: Re: Server Error Reports
Post by: mnementh on July 07, 2020, 03:06:41 am
Not sure... like Gyro's example; I've had a post with a single image bork two older posts daisy-chain style. If I delete the borked pic to replace with the correct one, sometimes THAT pic will bork other older posts further down the thread. I think there's something messed up in how the database handles file pointers, m'self... but that's just drawn from hazy memories of Filesystems Forensics coursework in Uni almost 2 decades ago... :-//

mnem
 :=\
Title: Re: Server Error Reports
Post by: SilverSolder on July 07, 2020, 03:28:51 am
Not sure... like Gyro's example; I've had a post with a single image bork two older posts daisy-chain style. If I delete the borked pic to replace with the correct one, sometimes THAT pic will bork other older posts further down the thread. I think there's something messed up in how the database handles file pointers, m'self... but that's just drawn from hazy memories of Filesystems Forensics coursework in Uni almost 2 decades ago... :-//

mnem
 :=\

The messages and images may be served straight out of a database...   no file system involved.   It seems like a pretty ugly bug, though, that one message can affect another.  Definitely things are being scrambled somewhere in the system, possibly incompatible libraries after a patch or update, or something like that.
Title: Re: Server Error Reports
Post by: tautech on July 07, 2020, 03:45:51 am
Calling Dave, come in Dave.

What's going on ?  :popcorn:
Title: Re: Server Error Reports
Post by: mnementh on July 07, 2020, 05:40:30 pm
Not sure... like Gyro's example; I've had a post with a single image bork two older posts daisy-chain style. If I delete the borked pic to replace with the correct one, sometimes THAT pic will bork other older posts further down the thread. I think there's something messed up in how the database handles file pointers, m'self... but that's just drawn from hazy memories of Filesystems Forensics coursework in Uni almost 2 decades ago... :-//

mnem
 :=\

The messages and images may be served straight out of a database...   no file system involved.   It seems like a pretty ugly bug, though, that one message can affect another.  Definitely things are being scrambled somewhere in the system, possibly incompatible libraries after a patch or update, or something like that.

Yeah, that's me misremembering/misusing terminology last grokked over a decade ago.  :palm: gnif stated a couple pages back (https://www.eevblog.com/forum/chat/website-error-reports/msg3104596/#msg3104596) in the interest of transparency that SMF stores all attachments as a hash of the file contents and references them via a table. To me this sounded like pointers (base address and offset address in a table?) and I probably should've kept my mouth shut.  :-DD

If you don't use it you lose it. ;)

mnem
*goes and stands in the corner*
Title: Re: Server Error Reports
Post by: SilverSolder on July 07, 2020, 08:43:35 pm
Not sure... like Gyro's example; I've had a post with a single image bork two older posts daisy-chain style. If I delete the borked pic to replace with the correct one, sometimes THAT pic will bork other older posts further down the thread. I think there's something messed up in how the database handles file pointers, m'self... but that's just drawn from hazy memories of Filesystems Forensics coursework in Uni almost 2 decades ago... :-//

mnem
 :=\

The messages and images may be served straight out of a database...   no file system involved.   It seems like a pretty ugly bug, though, that one message can affect another.  Definitely things are being scrambled somewhere in the system, possibly incompatible libraries after a patch or update, or something like that.

Yeah, that's me misremembering/misusing terminology last grokked over a decade ago.  :palm: gnif stated a couple pages back (https://www.eevblog.com/forum/chat/website-error-reports/msg3104596/#msg3104596) in the interest of transparency that SMF stores all attachments as a hash of the file contents and references them via a table. To me this sounded like pointers (base address and offset address in a table?) and I probably should've kept my mouth shut.  :-DD

If you don't use it you lose it. ;)

mnem
*goes and stands in the corner*

What we are seeing is a fault of that type -  relationship between two logical entities has gone amiss, whether implemented as pointers or references to another table or whatever.  FUBAR covers it!  :D
Title: Re: Server Error Reports
Post by: dcac on July 10, 2020, 09:07:13 pm
I've encountered this nasty picture posting bug with my posts in this thread: https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/msg3128860/#msg3128860 (https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/msg3128860/#msg3128860) , they should have two pictures each. But only the first uploaded picture seemed to be affected. Trying a couple of times re-uploading and saving the post again seemed to fix it. But not so lucky on the last post it just seems to hang during upload when I try to modify it.

Title: Re: Server Error Reports
Post by: Cerebus on July 11, 2020, 02:33:29 am
Given that this seems to be happening to the same people repeatedly (I'm looking at you Mnem) and not to just everybody at random, can I suggest that the people who've experienced this post what combination of browser/version/platform that they are using? It has the flavour of being something like a change in platform javascript behaviour, perhaps tied to a particular recent version/update. If my hypothesis is right we should see some commonality between the setups of people that it's happening to, if it's wrong then we won't.
Title: Re: Server Error Reports
Post by: StillTrying on July 11, 2020, 12:47:23 pm
Given that this seems to be happening to the same people repeatedly.

Yes it only effects some of us and some images, but it's not at our end. https://www.eevblog.com/forum/chat/website-error-reports/msg3104478/#msg3104478 (https://www.eevblog.com/forum/chat/website-error-reports/msg3104478/#msg3104478)

I've added a spare rigoltime.png attachment to see if that one changes, I'd already removed and replaced the first one but it changed again. :)
https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/msg3103617/#msg3103617 (https://www.eevblog.com/forum/chat/does-a-capacitor-charges-smooth-or-in-stairs/msg3103617/#msg3103617)

[attachimg=1]
Title: Re: Server Error Reports
Post by: dcac on July 11, 2020, 01:13:53 pm
https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/msg3130828/#msg3130828 (https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/msg3130828/#msg3130828)

Trying to workaround the bug I only posted one pic/post on my last two posts - but both got affected anyway - post #1 I noticed immediately - had correct thumbnail but opened up the pic from post#2 - I re-uploaded pic to #1 and that fixed it. Both posts were correct 12h ago but now post#2 opens the pic from #1.

Are we being cyber attacked?!

Title: Re: Server Error Reports
Post by: Brumby on July 11, 2020, 01:31:10 pm
Not that I'm aware of.

Gnif knows about it and is trying to find the time to track this down.  (Remember, he puts in is own time for free to look after this place.)
Title: Re: Server Error Reports
Post by: mnementh on July 11, 2020, 05:48:07 pm
Given that this seems to be happening to the same people repeatedly (I'm looking at you Mnem) and not to just everybody at random, can I suggest that the people who've experienced this post what combination of browser/version/platform that they are using? It has the flavour of being something like a change in platform javascript behaviour, perhaps tied to a particular recent version/update. If my hypothesis is right we should see some commonality between the setups of people that it's happening to, if it's wrong then we won't.

Nahhhh... it's happening to lots of people. You just notice it more with me because I'm a heavy abuser of visual aids; goes with the territory being the class clown. ;)

I've been trying to find a process which ameliorates the issue; right now I'm doing this:

I make sure I finish the longish process of editing the text of a pic-laden post and click "Review" just before adding pics to eliminate the possibility of a "There are new posts" red flag ducking up my file uploads; this has been going on since long before this latest SMF indignity.  |O  BTW, I have confirmed that it isn't just image files which get borked; I had a .pdf wind up in limbo the same way not too long ago.

Also, I make sure to:

Resize my pics to ~300k or less

Upload 3 or less at a time, and

Wait 10 seconds after the last pic is "uploaded" before I click "POST" or "SAVE" so the process completes as quickly as possible.

This ties in (I think) with the notion gnif proffered a while back that the issue is related to lag in propagation between servers; at first I thought it might have been because I sortof straddle 2 transatlantic trunks here in Toronto, but extensive trial & error found no correlation with whether I was using my VPN (server in New Jersey) or not. :-//

When I DO get a borked pic, I try to fix it by just adding that pic again and linking to the new pic rather than deleting the faulty pic and replacing it. This seems to lessen the likelihood that fixing a post will then bork another older post in the thread. It SEEMS to; that may just be confirmation bias. :-//

Good hunting, gnif!

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: dcac on July 11, 2020, 06:30:39 pm
Some more info:

From the PC I made the #1 and #2 mentioned posts - both pictures are still correct - I can open the page in a new window or restart Firefox or reload the page over and over - and they are still correct.

But if I open the page in a new private window in Firefox - clicking the thumbnail in post #2 shows the pic from post #1. And this is also the case if I open the page from any other PC.

EDIT:

Also just tested - if I log out from eevblog the behavior is the same as I described.

Perhaps the behavior has something to do with the cookies stored on the PC I posted from - I don't know.


Title: Re: Server Error Reports
Post by: amyk on July 12, 2020, 03:23:37 am
I just experienced this image bug with two posts here:
https://www.eevblog.com/forum/repair/old-cnc-machine-memory-board/ (https://www.eevblog.com/forum/repair/old-cnc-machine-memory-board/)

The image URLs are:
https://www.eevblog.com/forum/repair/old-cnc-machine-memory-board/?action=dlattach;attach=1021664;image (https://www.eevblog.com/forum/repair/old-cnc-machine-memory-board/?action=dlattach;attach=1021664;image)

https://www.eevblog.com/forum/repair/old-cnc-machine-memory-board/?action=dlattach;attach=1021660;image (https://www.eevblog.com/forum/repair/old-cnc-machine-memory-board/?action=dlattach;attach=1021660;image)

Note that they are different, but the contents are exactly the same.

HTTP headers of the two for comparison:
Code: [Select]
HTTP/1.1 200 OK
Server: nginx
Date: Sun, 12 Jul 2020 03:18:39 GMT
Content-Type: image/jpeg
Transfer-Encoding: chunked
Connection: keep-alive
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1
X-Content-Type-Options: nosniff
Content-Encoding: none
Pragma:
Content-Transfer-Encoding: binary
Expires: Mon, 12 Jul 2021 03:18:39 GMT
Last-Modified: Sun, 12 Jul 2020 01:40:14 GMT
Accept-Ranges: bytes
ETag: "10216643-711-2615G.jpg1594518014"
Content-Disposition: inline; filename="3-711-2615G.jpg"
Cache-Control: max-age=31536000, private
X-Backend: web1.eevblog.com

Code: [Select]
HTTP/1.1 200 OK
Server: nginx
Date: Sun, 12 Jul 2020 03:18:53 GMT
Content-Type: image/jpeg
Transfer-Encoding: chunked
Connection: keep-alive
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1
X-Content-Type-Options: nosniff
Content-Encoding: none
Pragma:
Content-Transfer-Encoding: binary
Expires: Mon, 12 Jul 2021 03:18:53 GMT
Last-Modified: Sun, 12 Jul 2020 01:40:14 GMT
Accept-Ranges: bytes
ETag: "10216603 542 1174A.JPG1594518014"
Content-Disposition: inline; filename="3 542 1174A.JPG"
Cache-Control: max-age=31536000, private
X-Backend: web2.eevblog.com

It claims the filenames are different but the last-modified for the two are the same, as-is the timestamp-ish part of the ETag (which translates precisely to the last-modified.)
Title: Re: Server Error Reports "Thread-Problems with uploaded attachements!"
Post by: PushUp on July 12, 2020, 08:28:40 am
Thread-Problems with uploaded attachements!


As mentioned by TV84, this might be a big problem:
https://www.eevblog.com/forum/testgear/new-rigol-16-bit-function-generators-dg800900-series/msg3122658/#msg3122658 (https://www.eevblog.com/forum/testgear/new-rigol-16-bit-function-generators-dg800900-series/msg3122658/#msg3122658)

As long as only pictrures are concerned, it is simply annoying, compared to the effort you had with making, downsizing (to meet the max. 5MB limit) and last but not least uploading the images to your post.

The problem:
The Thumbnail-Picture is still fine, but the link to it is wrong and leads to a completely false picture. It is somehow messed up with any (!!!) further reply you make in the forum, I guess?!

Here is an example:
https://www.eevblog.com/forum/testgear/uni-t-ut181a-triplett-9065-trend-viewer-question/msg3132148/#msg3132148 (https://www.eevblog.com/forum/testgear/uni-t-ut181a-triplett-9065-trend-viewer-question/msg3132148/#msg3132148)

The thumbnail of the first pic is correct, but it leads to the picture from my next reply, therefore it was somehow replaced by it, which leads to a mess, as described pictures are gone and the message gets useless...

Probably, it is better to use external image/file hoster, till the problem is solved to avoid a total mess?!


Cheers!
Title: Re: Server Error Reports
Post by: SilverSolder on July 12, 2020, 11:19:54 am

I wonder why some people get less problems...

One thing that might vary from user to user, is how the files are named.   Do you always give the image a unique name in every post (including, being unique across all posts)?

Title: Re: Server Error Reports
Post by: dcac on July 12, 2020, 11:36:22 am
When I post multiple pics they are usually from the same folder and therefor also has a unique name.

I wonder if the problem is more related to the amount of server traffic when you post the pictures/attachments.

Title: Re: Server Error Reports
Post by: dcac on July 12, 2020, 11:39:12 am
This is the 'element code' of my two mentioned posts/pics from a PC that opens same image from both - or shows the error.

When I get access to the PC I made those post from I do the same thing to see if any difference appear.

Code: [Select]
<a href="https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021018;image" id="link_1021018-0" onclick="return ILAexpandThumb(1021018-0);"><img src="https://www.eevblog.com/forum/index.php?action=dlattach;topic=240210.0;attach=1021020;image" alt="1021018-0" title="Show us your mains waveform!" id="thumb_1021018-0" style="width:100px;border:0;" data-pagespeed-url-hash="2538578502" onload="pagespeed.CriticalImages.checkImageForCriticality(this);"></a>

Code: [Select]
<a href="https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021014;image" id="link_1021014-0" onclick="return ILAexpandThumb(1021014-0);"><img src="https://www.eevblog.com/forum/index.php?action=dlattach;topic=240210.0;attach=1021016;image" alt="1021014-0" title="Show us your mains waveform!" id="thumb_1021014-0" style="width:100px;border:0;" data-pagespeed-url-hash="1545177425" onload="pagespeed.CriticalImages.checkImageForCriticality(this);"></a>

EDIT: well the code is exactly the same from the PC that can open correct image - no big surprise there but I'm still puzzled how it manage to fetch the correct image it does not seem to get it from Firefox cache.

EDIT2: so what I am essentially observing is this link:

https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021014;image (https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021014;image)

will open correct image from the PC I posted/uploaded it from and show a sine wave in blue. But if I open it from any other PC it opens the image from my previous post and show a sine wave in red.

All thumbnails are shown correctly from all PC I've tested.
 
Title: Re: Server Error Reports
Post by: SilverSolder on July 12, 2020, 12:17:07 pm
This is the 'element code' of my two mentioned posts/pics from a PC that opens same image from both - or shows the error.

When I get access to the PC I made those post from I do the same thing to see if any difference appear.

Code: [Select]
<img src="https://www.eevblog.com/forum/index.php?action=dlattach;topic=240210.0;attach=1021020;image" alt="1021018-0" title="Show us your mains waveform!" id="thumb_1021018-0" style="width:100px;border:0;" data-pagespeed-url-hash="2538578502" onload="pagespeed.CriticalImages.checkImageForCriticality(this);">
Code: [Select]
<img src="https://www.eevblog.com/forum/index.php?action=dlattach;topic=240210.0;attach=1021016;image" alt="1021014-0" title="Show us your mains waveform!" id="thumb_1021014-0" style="width:100px;border:0;" data-pagespeed-url-hash="1545177425" onload="pagespeed.CriticalImages.checkImageForCriticality(this);">

When I hit those two links (the img src links) from here, they are definitely different thumbnails.
Title: Re: Server Error Reports
Post by: rhb on July 12, 2020, 01:04:40 pm
I think it affects all attachments.  IIRC I had an Octave script that got posted as a jpg which I deleted when I couldn't open the image.

Reg
Title: Re: Server Error Reports
Post by: amyk on July 13, 2020, 01:46:03 am
EDIT2: so what I am essentially observing is this link:

https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021014;image (https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021014;image)

will open correct image from the PC I posted/uploaded it from and show a sine wave in blue. But if I open it from any other PC it opens the image from my previous post and show a sine wave in red.

All thumbnails are shown correctly from all PC I've tested.
From that link I am seeing a red sine wave.

Note: you should be able to do ctrl+F5 to force a reload from network and not cache, in most browsers. You can also directly access the network, with guarantee of no caching, by using utility like wget or curl.
Title: Re: Server Error Reports
Post by: dcac on July 13, 2020, 01:55:16 pm
EDIT2: so what I am essentially observing is this link:

https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021014;image (https://www.eevblog.com/forum/projects/show-us-your-mains-waveform!/?action=dlattach;attach=1021014;image)

will open correct image from the PC I posted/uploaded it from and show a sine wave in blue. But if I open it from any other PC it opens the image from my previous post and show a sine wave in red.

All thumbnails are shown correctly from all PC I've tested.
From that link I am seeing a red sine wave.

Note: you should be able to do ctrl+F5 to force a reload from network and not cache, in most browsers. You can also directly access the network, with guarantee of no caching, by using utility like wget or curl.

Yeah I finally manage to clear the Firefox cache - though I had to clear it restart FF and then clear it again. Now the posting PC also fetches the wrong image which is the red sine wave. I didn't clear any cookies so these probably had no effect on this problem.
Title: Re: Server Error Reports
Post by: T3sl4co1l on July 14, 2020, 06:24:33 am
Also, can we have some way to disable Imgur embeds?

Say I post a link, a raw URL, not an img embed, and that's literally all I want.

There exists no combination of Imgur URL (gallery or direct link) that won't auto embed.  It's way too greedy.

Often I want to refer to links inline with text and this BIG MOTHERFUCKING EMBED interrupts my text, it's ridiculous.

YouTube embeds do the same thing, but there at least you can use a shortened link to evade it (IIRC?).

Tim
Title: Re: Server Error Reports
Post by: BrianHG on July 15, 2020, 09:37:24 pm
Image files and attached files corruptions going MAD.....

Example, 3 corrupt images on this thread page:
https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3135492/#msg3135492 (https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3135492/#msg3135492)
Scroll down, the errors are over a few posts...

Try expanding the timing diagram in this post:
https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3121924/#msg3121924 (https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3121924/#msg3121924)

try expanding the second image in this post:
https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3111866/#msg3111866 (https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3111866/#msg3111866)

Or this one:
https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3111884/#msg3111884 (https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3111884/#msg3111884)

This one has the wrong image:
https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/1075/ (https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/1075/)

This one is also corrupt:
https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3107130/#msg3107130 (https://www.eevblog.com/forum/fpga/fpga-vga-controller-for-8-bit-computer/msg3107130/#msg3107130)

The top example now has 4 corrupt images.  Yes, 1 new one in the time I've been writing this message if you go to the first link and scroll up instead of down.  Those images were there fine yesterday.

Here is another one:
https://www.eevblog.com/forum/fpga/home-made-systemverilog-3-word-zero-latency-fifo-documented-for-beginners/msg3123336/#msg3123336 (https://www.eevblog.com/forum/fpga/home-made-systemverilog-3-word-zero-latency-fifo-documented-for-beginners/msg3123336/#msg3123336)

In fact, over the last week, I've editing my posts, deleting & re-uploading images again & again.
Does anyone know what's been going on?
Title: Re: Server Error Reports
Post by: amyk on July 16, 2020, 01:26:16 pm
Also, can we have some way to disable Imgur embeds?

Say I post a link, a raw URL, not an img embed, and that's literally all I want.

There exists no combination of Imgur URL (gallery or direct link) that won't auto embed.  It's way too greedy.

Often I want to refer to links inline with text and this BIG MOTHERFUCKING EMBED interrupts my text, it's ridiculous.

YouTube embeds do the same thing, but there at least you can use a shortened link to evade it (IIRC?).

Tim
Quote my post or click this link (https://i.imgur.com./oSzpxwL.png) to find out how to get around that. ;)
Title: Re: Server Error Reports
Post by: tooki on July 18, 2020, 04:04:34 pm
People! It’s a known issue, and it’s got nothing to do with your browser cache or anything, as it’s purely a server database problem. It seems to be triggered by interrupted posting.


In fact, over the last week, I've editing my posts, deleting & re-uploading images again & again.
Does anyone know what's been going on?
Yes.

See what the server admin has said, starting here: https://www.eevblog.com/forum/chat/website-error-reports/msg3107598/#msg3107598 (https://www.eevblog.com/forum/chat/website-error-reports/msg3107598/#msg3107598)
Title: Re: Server Error Reports
Post by: mnementh on July 23, 2020, 03:19:56 am
A fellow eevBlog member has suggested a possible workaround:

I think there's a problem only with the first attachment slot. If you skip the first one and use the other one it appear to be working fine.

(https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1029256;image)

I'm going to try this for a few days and see if it makes any difference.

Cheers,

mnem
(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1029384;image)
Title: Re: Server Error Reports
Post by: mnementh on July 24, 2020, 04:01:14 pm
Update: So far, this method seems to be working. Even survives being interrupted by "There has been a new post" warning and a 4.1MB .pdf.

Will followup again in a day or three.

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: dcac on July 25, 2020, 12:21:09 pm
I'm getting 404 error trying to access this thread:

https://www.eevblog.com/forum/testgear/eevblog-121gw-multimeter-issues (https://www.eevblog.com/forum/testgear/eevblog-121gw-multimeter-issues)

Title: Re: Server Error Reports
Post by: joeqsmith on July 25, 2020, 03:41:13 pm
Obviously the photo links continues to not work.   I tried to delete a picture that was inserted in one post but was being referenced in another.  This had no effect.  So I blew away the entire post which also had no effect.

I'm not sure if they keep metrics on who posts the most pictures but I suspect I abuse it far more than most.   I wonder if I were to start deleting my old posts/images would it help ease the problem?   If so, just let me know and I will start cleaning up my mess.
Title: Re: Server Error Reports
Post by: StillTrying on July 25, 2020, 04:21:45 pm
I post nothing compared to others but still see the errors.
Post 2 of everything then a few hours later delete the spare or faulty versions. :-/O  :)
Title: Re: Server Error Reports
Post by: joeqsmith on July 25, 2020, 04:30:32 pm
I was thinking that it's overall just too much data for the software to handle.    Looking at my attachments, there's 121 pages of 25 images/page or over 3000 images spanning 5 years.   That's a lot of images.     
Title: Re: Server Error Reports
Post by: mnementh on July 25, 2020, 06:21:34 pm
I think there's a problem only with the first attachment slot. If you skip the first one and use the other one it appear to be working fine.

(https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1029256;image)

FWIW: This workaround is still working for me.

mnem
*knocks on wood*
Title: Re: Server Error Reports
Post by: Monkeh on July 25, 2020, 06:26:28 pm
I was thinking that it's overall just too much data for the software to handle.    Looking at my attachments, there's 121 pages of 25 images/page or over 3000 images spanning 5 years.   That's a lot of images.   

That's a really, really small number of files.

It seems more like a database replication issue.
Title: Re: Server Error Reports
Post by: joeqsmith on July 25, 2020, 07:26:55 pm
I cleaned up most of what I consider my worthless posts.   I would need to take down some of my larger threads to really make a dent in it but even if I cleaned everything out,  I don't see it helping with this particular problem.   

Title: Re: Server Error Reports
Post by: mnementh on July 25, 2020, 11:27:40 pm
I was thinking that it's overall just too much data for the software to handle.    Looking at my attachments, there's 121 pages of 25 images/page or over 3000 images spanning 5 years.   That's a lot of images.   

That's a really, really small number of files.

It seems more like a database replication issue.

This is the latest I know of from gnif when he was available to work on the problem:

...I usually use Firefox on my PCs; I brought up the thread on my iPad/Firefox and still FUBAR the same way, so not a local cache issue. Same behavior in Edge.
 
This may be related to another bug that has been happening for months; when posting multiple images, IF the posting process is interrupted for a new post warning, the damned thing just forgets the first pic. It attaches the rest of the pics normally, but that first one you ALWAYS have to go back and attach again...  [edited for brevity]

mnem
Déjà vu: Best enjoyed as a garnish with wine, cheese and baguettes.
SMF doesn't care about the filename, it stores all attachments as a hash of the file contents and references them via a table. There are two possible reasons why this happened:

1) The bug you mentioned
2) The maintenance last night was intended to correct some sync issues between the web servers as the database cluster had lost sync. Normally this would be fine, but there were other factors at play at the same time that prevented them from determining who was the "latest" and both were accepting update/insert queries at the same time (split-brain).

I should have been clearer I am sorry, if this is seen on new posts as of today, please let me know. Feel free to fix any that are messed up from prior.

Since then it has been off & on, though server loading does affect it. It def happens a lot more often on weekends.

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: mnementh on July 27, 2020, 01:55:51 pm
I think there's a problem only with the first attachment slot. If you skip the first one and use the other one it appear to be working fine.

(https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1029256;image)

This workaround is still working for me. Last night I posted a mini how-to with 10 pics; deliberately did not wait for all the pics and just hit [POST]. eevBlog gagged on it for a few seconds, then popped up a THERE HAS BEEN A NEW POST warning. But after I clicked [POST] again, all the pics came up without issue; they were even in the right order for a change.

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: tooki on July 27, 2020, 09:11:14 pm
OK, so here's another data point for you, Gnif!

I just posted a thread reply (https://www.eevblog.com/forum/chat/retracting-my-prior-statements-on-cty-that-cty-is-gone/msg3159832/#msg3159832) with an inline image attachment. I didn't pay attention to whether the attachment icon showed up on the post before going in to modify the post. After saving the modified post, I noticed that while the inline image still appears properly, it shows no attachment icon, and clicking on Modify again also shows no attachment to remove!! (I've verified that in another pre-bug post with inline attachments, they still show up as attachments in the Modify screen.)
Title: Re: Server Error Reports
Post by: tautech on July 27, 2020, 09:25:23 pm
I think there's a problem only with the first attachment slot. If you skip the first one and use the other one it appear to be working fine.

(https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1029256;image)

This workaround is still working for me. Last night I posted a mini how-to with 10 pics; deliberately did not wait for all the pics and just hit [POST]. eevBlog gagged on it for a few seconds, then popped up a THERE HAS BEEN A NEW POST warning. But after I clicked [POST] again, all the pics came up without issue; they were even in the right order for a change.

mnem
 :popcorn:
This has been working perfect for me too.  :)

Pauses between Post and the forum showing the post are due to the time it takes for attachments to load whereas when you place an attachment in the first box it gets loaded onto the database before posting.

Like others I now just skip the first Attachment box and sidestep all the grief of needing to fix busted image links later.  :horse:
Title: Re: Server Error Reports
Post by: SilverSolder on July 27, 2020, 09:46:27 pm

I haven't had an issue posting single images, only counts >1 seem to be an issue.  Is that true for you as well?
Title: Re: Server Error Reports
Post by: tautech on July 27, 2020, 10:23:32 pm

I haven't had an issue posting single images, only counts >1 seem to be an issue.  Is that true for you as well?
I believe so......not 100% sure.
Never had issues until a few days ago when other images/attachments I'd posted got linked into the wrong posts.  :o
Had to delete the attachments and re-upload them then re-link them to where they needed to be.
Annoying but fixable.  :phew:

Rarely use the direct embed image thing or the drag and drop instead sticking to the old method we've had for years until recently when it corrupts links from thumbnails to between [i m g] link [/ i m g] flags whereas from the 2nd attachment box seems to work fine....for now.  :-\
Title: Re: Server Error Reports
Post by: jancumps on July 28, 2020, 11:37:54 am
Forum attachment issues:

This comment: https://www.eevblog.com/forum/blog/get-your-lab-on-mailbag (https://www.eevblog.com/forum/blog/get-your-lab-on-mailbag!/msg3157064/#msg3157064)!/msg3157064/#msg3157064

Underneath the post, I see a small preview of someone's lab.
When I click to enlarge, I get a printscreen of a free energy blog post.
Is something off?
Title: Re: Server Error Reports
Post by: PA0PBZ on July 28, 2020, 12:34:32 pm
Forum attachment issues:
Is something off?

You obviously didn't read the last 2 pages?
Title: Re: Server Error Reports
Post by: BrianHG on July 29, 2020, 09:24:13 pm
People! It’s a known issue, and it’s got nothing to do with your browser cache or anything, as it’s purely a server database problem. It seems to be triggered by interrupted posting.


In fact, over the last week, I've editing my posts, deleting & re-uploading images again & again.
Does anyone know what's been going on?
Yes.

See what the server admin has said, starting here: https://www.eevblog.com/forum/chat/website-error-reports/msg3107598/#msg3107598 (https://www.eevblog.com/forum/chat/website-error-reports/msg3107598/#msg3107598)

I have managed to replicate this, it seems to be caused when you try to post the message before the attachment has finished uploading, or you cancel an attachment and then upload another. Still trying to nut down the exact sequence of events that cause it.
This is not the bug I'm getting.  I've have waited for images and other attachments to upload, like tiny ones of 10-75kb files.  They are fine for anywhere around 1 hour to 5 days, then the files either get corrupt or replaced with other files.

The tiny icon versions seem to have the right image, but the real photo inside isn't the right one, yet, a few days ago, everything was correct.

Example:
Bad file: https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3153558/#msg3153558 (https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3153558/#msg3153558)
Second image is wrong: https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3154396/#msg3154396 (https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3154396/#msg3154396)
First image bad: https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3152154/#msg3152154 (https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3152154/#msg3152154)
Wrong image: https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3152816/#msg3152816 (https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3152816/#msg3152816)
First 2 images wrong: https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3147392/#msg3147392 (https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3147392/#msg3147392)
Third image wrong image: https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3147392/#msg3147392 (https://www.eevblog.com/forum/projects/modern-equivalent-of-74hc4046-pll/msg3147392/#msg3147392)

Back on the 25th, almost all these images were good.
Title: Re: Server Error Reports
Post by: mnementh on July 30, 2020, 11:40:18 am
Yeah, that's because you uploaded other files thereafter; THEY borked your attached files further back in the timeline. Has happened to my pics kaboodles of times over the last month; sometimes days later. This NO LONGER HAPPENS if I do not use the first attachment radio button as shown above.

Cheers,

mnem
 :horse:
Title: Re: Server Error Reports
Post by: Cerebus on July 30, 2020, 04:27:44 pm
Yeah, that's because you uploaded other files thereafter; THEY borked your attached files further back in the timeline. Has happened to my pics kaboodles of times over the last month; sometimes days later. This NO LONGER HAPPENS HAS NOT HAPPENED AGAIN YET if I do not use the first attachment radio button as shown above.


There, fixed that for ya. You should know better than to bait Murphy like that.  :)
Title: Re: Server Error Reports
Post by: mnementh on July 30, 2020, 06:30:27 pm
Fair dinkum.  ;)

But OTOH, maybe I should press my luck, for sake of the scientific method...

mnem
 :-/O
Title: Re: Server Error Reports
Post by: tautech on July 30, 2020, 10:00:47 pm
Side stepping the first attachment button as is norm these days to get reliable links to thumbnails has worked like a charm however an interesting development today with a thumbnail not being a thumbnail !  :o  :-//
2nd thumbnail:
https://www.eevblog.com/forum/beginners/what-an-oscilloscope-recommended-for-a-woman-passionate-about-electronics/msg3165582/#msg3165582 (https://www.eevblog.com/forum/beginners/what-an-oscilloscope-recommended-for-a-woman-passionate-about-electronics/msg3165582/#msg3165582)
Title: Re: Server Error Reports
Post by: mnementh on July 31, 2020, 05:08:41 am
I've seen that too, but it always seemed to be related to a failed upload via the current 1st button PITA. Have not personally experienced it since using the workaround.

Is it possible you accidentally forgot and used the first button? I have a few times and paid the price. :-DD

mnem
 :palm:
Title: Re: Server Error Reports
Post by: tautech on July 31, 2020, 05:38:27 am
I've seen that too, but it always seemed to be related to a failed upload via the current 1st button PITA. Have not personally experienced it since using the workaround.

Is it possible you accidentally forgot and used the first button? I have a few times and paid the price. :-DD

mnem
 :palm:
Nope, most certainly not. Wouldn't have bought it here if I wasn't damn sure about that.
Title: Re: Server Error Reports
Post by: DrG on July 31, 2020, 07:58:50 pm
FWIW I have been using the, skip the first slot, method for the last week or so and have not seen any problems yet.
Title: Re: Server Error Reports
Post by: tautech on July 31, 2020, 08:09:45 pm
FWIW I have been using the, skip the first slot, method for the last week or so and have not seen any problems yet.
Yet it seems pretty reliable other than the one hiccup I had.
Title: Re: Server Error Reports
Post by: mnementh on August 01, 2020, 03:00:58 am
 :popcorn:

mnem
I don't always put some pithy remark down here.
Title: Re: Server Error Reports
Post by: bitseeker on August 02, 2020, 07:04:31 am
LOL, mnem! I was wondering about the lack of pithy remark, previously.
Title: Re: Server Error Reports
Post by: mnementh on August 03, 2020, 03:07:11 pm
Mmkay... I just had a bona-fide FAIL of the "Skip the first" workaround.

Tried to post a 492K gif (seen below; is supposed to be animated); eevBlog gagged on it and then gave the "a new post has been made" popup. Then, the giant blank thumbnail FAIL. Then, new behavior, returned an Error 404 when I clicked on the link in the message. Eventually gave up and just linked from giphy.com.

For historical record, high demand on the TEA thread: 20 regular named users, 66 visitors at the time.

[EDIT]

GIF wound up here: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1038938;image (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1038938;image)

Attached to this post from 2 days ago: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3168730/#msg3168730 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3168730/#msg3168730)

It displaced the image of a Grid laptop; which then displaced another image somewhere, I'm sure. :palm:

Cheers,

mnem
 :popcorn:

Title: Re: Server Error Reports
Post by: BrianHG on August 06, 2020, 05:28:02 pm
Errors still poping up and the second file attachments slot BS doesn't help either.  Even on files as small as 2kb.
A 0.97 kbyte file completely dissipated which now reports '404 - Attachment not found'.
Title: Re: Server Error Reports
Post by: EEVblog on August 07, 2020, 11:07:17 am
TEST. I have disabled the line attachments plugin to see if it makes a difference.

(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1042536;image)
Title: Re: Server Error Reports
Post by: EEVblog on August 07, 2020, 11:24:07 am
TEST

[attachimg=1]
Title: Re: Server Error Reports
Post by: mnementh on August 08, 2020, 02:05:47 pm
(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1043286;image)

Okay... so this means we'll have to use img tags for inline pix? No problem. It'll encourage people (I hope) to use the height= & width= modifiers to limit eye pollution. :-+

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: mnementh on August 09, 2020, 04:26:53 pm
Nope. Still messing with our heads if we use the first attachment button. Attachment made here: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3181178/#msg3181178 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3181178/#msg3181178)

was supposed to be this: (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1043900;image)

Instead it cascaded back to here, displacing the exploding head emoji: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3181032/#msg3181032 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3181032/#msg3181032)

The image of Ferengi Quark it linked to instead was from a THIRD post, which appears unchanged: https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3181088/#msg3181088 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3181088/#msg3181088)

(https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/?action=dlattach;attach=1029256;image)

I'm going back to the "Skip the first" workaround.

Thanks for trying, Dave!  :-+

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: mnementh on August 10, 2020, 02:59:28 am
Wow... great. The bug borked another pic, which just messed up those three posts above AGAIN.  |O This is getting comical...

mnem
"Dying is easy; now comedy... that's hard." ~Edmund Gwenn
Title: Re: Server Error Reports
Post by: DrG on August 10, 2020, 02:35:01 pm
FWIW I have been using the, skip the first slot, method for the last week or so and have not seen any problems yet.
Yet it seems pretty reliable other than the one hiccup I had.

That second png reports an error in PS if I try to dl it.

Wow... great. The bug borked another pic, which just messed up those three posts above AGAIN.  |O This is getting comical...

mnem
"Dying is easy; now comedy... that's hard." ~Edmund Gwenn

as does the gif @mnementh

Is corruption a new phenomenon?
Title: Re: Server Error Reports
Post by: EEVblog on August 12, 2020, 01:04:54 am
Site was down today for a few hours, was just a PHP lockup or some such, fixed now.
Title: Re: Server Error Reports
Post by: mnementh on August 13, 2020, 03:06:46 am
FWIW I have been using the, skip the first slot, method for the last week or so and have not seen any problems yet.
Yet it seems pretty reliable other than the one hiccup I had.

That second png reports an error in PS if I try to dl it.

Wow... great. The bug borked another pic, which just messed up those three posts above AGAIN.  |O This is getting comical...

mnem
"Dying is easy; now comedy... that's hard." ~Edmund Gwenn

as does the gif @mnementh

Is corruption a new phenomenon?

Yeah... eevBlog has had a wandering singularity ever since the last software update; it randomly erases pics from our current timeline. When the singularity eats a pic, it is "unmade" as if it never existed; which makes every pic associated with a user that came after that shift down a slot in the database. ;)  Much hilarity ensues.  :-DD

The "Skip the First" slot workaround casts a warding spell which usually works unless the server daemons are especially overloaded by high numbers of visitors to a thread; the singularity seems especially attracted to the busiest threads. *

mnem
*Complete and utter fabrication purely for grins & giggles. >:D

Title: Re: Server Error Reports
Post by: DrG on August 13, 2020, 03:17:01 am
FWIW I have been using the, skip the first slot, method for the last week or so and have not seen any problems yet.
Yet it seems pretty reliable other than the one hiccup I had.

That second png reports an error in PS if I try to dl it.

Wow... great. The bug borked another pic, which just messed up those three posts above AGAIN.  |O This is getting comical...

mnem
"Dying is easy; now comedy... that's hard." ~Edmund Gwenn

as does the gif @mnementh

Is corruption a new phenomenon?

Yeah... eevBlog has had a wandering singularity ever since the last software update; it randomly erases pics from our current timeline. When the singularity eats a pic, it is "unmade" as if it never existed; which makes every pic associated with a user that came after that shift down a slot in the database. ;)  Much hilarity ensues.  :-DD

The "Skip the First" slot workaround casts a warding spell which usually works unless the server daemons are especially overloaded by high numbers of visitors to a thread; the singularity seems especially attracted to the busiest threads. *

mnem
*Complete and utter fabrication purely for grins & giggles. >:D

That's a big Twinkie

https://www.youtube.com/watch?v=V13CZnUCOaQ (https://www.youtube.com/watch?v=V13CZnUCOaQ)
Title: Re: Server Error Reports
Post by: SilverSolder on August 13, 2020, 01:20:55 pm
FWIW I have been using the, skip the first slot, method for the last week or so and have not seen any problems yet.
Yet it seems pretty reliable other than the one hiccup I had.

That second png reports an error in PS if I try to dl it.

Wow... great. The bug borked another pic, which just messed up those three posts above AGAIN.  |O This is getting comical...

mnem
"Dying is easy; now comedy... that's hard." ~Edmund Gwenn

as does the gif @mnementh

Is corruption a new phenomenon?

Yeah... eevBlog has had a wandering singularity ever since the last software update; it randomly erases pics from our current timeline. When the singularity eats a pic, it is "unmade" as if it never existed; which makes every pic associated with a user that came after that shift down a slot in the database. ;)  Much hilarity ensues.  :-DD

The "Skip the First" slot workaround casts a warding spell which usually works unless the server daemons are especially overloaded by high numbers of visitors to a thread; the singularity seems especially attracted to the busiest threads. *

mnem
*Complete and utter fabrication purely for grins & giggles. >:D



Perhaps somehow 5G is to blame for this?!?  :D
Title: Re: Server Error Reports
Post by: sokoloff on August 27, 2020, 03:08:15 pm
SSL cert expired a couple hours ago. (Time now is 11:08 AM EDT.)

Title: Re: Server Error Reports
Post by: BrianHG on August 27, 2020, 06:03:43 pm
New firefox just gave me this:
Also something with the SSL security...
Title: Re: Server Error Reports
Post by: IanB on August 27, 2020, 06:06:44 pm
Chrome this morning has also told me the SSL certificate is not valid.

We may have to wait for the working day in Australia to start before it will be fixed.
Title: Re: Server Error Reports
Post by: PA0PBZ on August 27, 2020, 06:07:45 pm
There are 2 servers with a load balancer, one has an expired certificate and the other is still valid till the end of October. Which server you get depends on the dice in the load balancer.
Title: Re: Server Error Reports
Post by: gnif on August 28, 2020, 02:11:22 am
There are 2 servers with a load balancer, one has an expired certificate and the other is still valid till the end of October. Which server you get depends on the dice in the load balancer.

You are correct, one of the server had faulted and was not renewing it's certificate. This has been corrected.
Title: Re: Server Error Reports
Post by: tautech on August 28, 2020, 02:17:18 am
one of the server had faulted and was not renewing it's certificate. This has been corrected.
Yet Chrome is still displaying a Not Secure flag.  :-//
Same result with a manual refresh or F5 refresh.
Title: Re: Server Error Reports
Post by: xrunner on August 28, 2020, 02:22:33 am
All good here now!  :-+
Title: Re: Server Error Reports
Post by: gnif on August 28, 2020, 02:24:08 am
one of the server had faulted and was not renewing it's certificate. This has been corrected.
Yet Chrome is still displaying a Not Secure flag.  :-//
Same result with a manual refresh or F5 refresh.

Your end sorry mate, I just double-checked that both servers are using valid certificates now.

Edit: Note, not-secure is different to an invalid certificate. You may be trying to access resources over `http`, make sure you're hitting the site over `https` and nobody has embedded any non https content on the page you're on.
Title: Re: Server Error Reports
Post by: tautech on August 28, 2020, 02:43:44 am
one of the server had faulted and was not renewing it's certificate. This has been corrected.
Yet Chrome is still displaying a Not Secure flag.  :-//
Same result with a manual refresh or F5 refresh.

Your end sorry mate, I just double-checked that both servers are using valid certificates now.

Edit: Note, not-secure is different to an invalid certificate. You may be trying to access resources over `http`, make sure you're hitting the site over `https` and nobody has embedded any non https content on the page you're on.
Yep all good, thanks. Definitely faster browsing and loading pages now.  :-+
Title: Re: Server Error Reports
Post by: IanB on August 28, 2020, 02:49:54 am
Your end sorry mate, I just double-checked that both servers are using valid certificates now.

Edit: Note, not-secure is different to an invalid certificate. You may be trying to access resources over `http`, make sure you're hitting the site over `https` and nobody has embedded any non https content on the page you're on.

With Chrome, if you insist on a "not secure" connection after an invalid certificate message, Chrome will remember that setting for several hours before trying again. You have to force Chrome back to an https connection manually if you don't want to wait. The best way to do that seems to be to close the current tab and then open a new one.
Title: Re: Server Error Reports
Post by: tautech on August 28, 2020, 02:53:30 am
The best way to do that seems to be to close the current tab and then open a new one.
Close an EEVblog tab  :o ......Never !   :-DD
Title: Re: Server Error Reports
Post by: Monkeh on September 01, 2020, 03:41:55 am
Absolutely beseiged by 502s today, is one or more of the servers suffering from a stroke, or just a lack of timely whipping?
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 03:45:14 am
Investigating, I was alerted to this about an hour ago, seems something is causing high I/O load.
Title: Re: Server Error Reports
Post by: tautech on September 01, 2020, 03:49:53 am
Investigating, I was alerted to this about an hour ago, seems something is causing high I/O load.
P76 of this thread:
https://www.eevblog.com/forum/testgear/siglent-sds2000x-plus-coming/ (https://www.eevblog.com/forum/testgear/siglent-sds2000x-plus-coming/)
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 03:50:58 am
Yup, it's that thread... thanks for that, looking for the dud file.
Title: Re: Server Error Reports
Post by: tautech on September 01, 2020, 03:53:19 am
Yup, it's that thread... thanks for that, looking for the dud file.
Was working fine late PM yesterday NZ time and I think another file was added overnight to an existing post that caused the issues.
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 04:01:45 am
Yup,

Issue fixed, another windows bitmap uploaded with a png extension. SMF goes nuts trying to load it and just hangs consuming tons of RAM.
Title: Re: Server Error Reports
Post by: Monkeh on September 01, 2020, 04:05:27 am
Who's posting nonsense like that?
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 04:09:11 am
I replied to them in the thread
Title: Re: Server Error Reports
Post by: Monkeh on September 01, 2020, 04:12:26 am
Thanks for the fix. Good old SMF, chainsaws round the edges.
Title: Re: Server Error Reports
Post by: Whales on September 01, 2020, 04:13:43 am
Gnif: that's a notable denial of service vuln.  Unhappy or banned users could come back and wreck all sorts of havoc. 

Is the problem in core SMF or an addon?  https://github.com/SimpleMachines/SMF2.1/issues
Title: Re: Server Error Reports
Post by: IanB on September 01, 2020, 05:59:16 am
Issue fixed, another windows bitmap uploaded with a png extension. SMF goes nuts trying to load it and just hangs consuming tons of RAM.

Ouch. Programs like SMF should not blindly trust file extensions, they should look inside the file to determine (or verify) the actual type of content.
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 06:00:04 am
Oh it certainly is, but it's not something that can be fixed easily.

SMF is dumb and just allows you to upload any file, and when it's an image attempts to create a thumbnail at render time (not at upload time), not only does this mean that multiple concurrent page loads will try to generate the thumbnail at once, if there are multiple images on the page, it will do them all at once (which can be slow) and cause a timeout, preventing the database from being updated with the information about the thumbnails.

The core workflow is very broken and fixing it will require overhauling how things work here. Such a "fix" would make SMF incompatible for future updates/upgrades.
Title: Re: Server Error Reports
Post by: magic on September 01, 2020, 06:04:44 am
At least the previewer should be fixed not to choke on malformed PNGs.
Is it exploitable for RCE too? ::)
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 06:11:24 am
I did add some idiot checks for this some time back but upgrades to SMF and/or modules have undone it. I will schedule some time to investigate and re-instate what I can.

I am not sure if it's a RCE issue, IIRC it's the thumbnail preview feature which I think is an "addon" (if you can call SMF addons 'addons', more like diffs/patches)
Title: Re: Server Error Reports
Post by: magic on September 01, 2020, 06:25:36 am
Hmm, I found this, which suggests that thumbnails are core SMF functionality. I have no idea, never administrated SMF myself.
https://wiki.simplemachines.org/smf/SMF2.0:Attachments_and_Avatars

RCE could possibly be an option if it's some old lousy C program which generates those thumbnails. If they actually wrote their own PHP scripts to parse those PNGs then maybe not. Again, no idea how they actually do it.
Title: Re: Server Error Reports
Post by: magic on September 01, 2020, 06:40:37 am
Isn't this the culprit?
https://github.com/SimpleMachines/SMF2.1/blob/release-2.1/Sources/Subs-Graphics.php#L395

It seems to use one of three libraries, depending on availability. I suppose you could see if installing a different backend solves it, or file a bug with the backend's vendor. I'm not sure if I would want to run remotely executable C binary which can't even recognize that it's being fed a BMP instead of PNG and tries to process it instead of bailing out.

Or maybe the backend does bail out and SMF goes nuts? Then it would be an SMF bug.
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 06:47:12 am
It needs to be fixed in SMF, it just hands everything to `imagecreatefrom` based on the extension.

```
Code: [Select]
        // A known and supported format?
        if (isset($default_formats[$sizes[2]]) && function_exists('imagecreatefrom' . $default_formats[$sizes[2]]))
        {
                $imagecreatefrom = 'imagecreatefrom' . $default_formats[$sizes[2]];
                if ($src_img = $imagecreatefrom($destination))
                {
                        resizeImage($src_img, $destination, imagesx($src_img), imagesy($src_img), $max_width === null ? imagesx($src_img) : $max_width, $max_height === null ? imagesy($src_img) : $max_height, true, $preferred_format);
                        $success = true;
                }
        }

This will call `imagecreatefrom` + extension, ie `imagecreatefrompng` with invalid data. It's just plain dumb. Tell a library that this is a PNG and hand it something else, expect things to break.

The solution here is to actually open the file and read the header to determine it's type. I am in the middle of writing a fix in now :)
Title: Re: Server Error Reports
Post by: magic on September 01, 2020, 07:02:08 am
And what if I take a BMP file and patch the PNG magic number into it? :P
Calling wrong function is one thing, the library being rubbish and failing to sanitize untrusted input is another :scared:
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 07:10:55 am
That's just it, the library is not failing, it's doing exactly what it's supposed to. The issue is that it's slow at it, and consumes a ton of ram, hitting the PHP limits and it gets terminated.
A highly compressed PNG with large dimensions will do exactly the same thing.

> And what if I take a BMP file and patch the PNG magic number into it?

gd will bomb out and stop, the issue is that GD can and will load a BMP as it's a generic image processing library that PHP wraps.

At it's core, the issue is SMF's poor design, image thumbnail generation should be a background task done by the server, NOT as part of a HTTP request.
Title: Re: Server Error Reports
Post by: magic on September 01, 2020, 07:22:26 am
This function should return an error when it's presented with a BMP file, not eat RAM like crazy. A BMP is not a highly compressed PNG.

the issue is that GD can and will load a BMP as it's a generic image processing library that PHP wraps
Does that mean that uploading the very same BMP with BMP extension causes the same problem?
Because if not, that's still a bug in libgd's PNG loader, rather than any problem with BMPs.
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 07:28:38 am
>Does that mean that uploading the very same BMP with BMP extension causes the same problem?
>Because if not, that's still a bug in libgd's PNG loader, rather than any problem with BMPs.

No idea, feel free to debug this and chase it with them. Simple fact of the matter is, we need a fix now. Fixing this issue is already well beyond the scope of the services I render for dave as it is.
Title: Re: Server Error Reports
Post by: bd139 on September 01, 2020, 09:29:51 am
It's definitely libgd's fault. A DoS attack from malformed input is definitely CVE-worthy. It should return E_WHAT_THE_FUCK_DID_YOU_GIVE_ME error or something if it can't parse the file.

Workaround....

Assumption: this is a FPM process or something running with nginx in front of it. Issue is memory ballooning

1. Set proper memory limits in systemd for the FPM process. See: https://www.freedesktop.org/software/systemd/man/systemd.exec.html#LimitCPU= (https://www.freedesktop.org/software/systemd/man/systemd.exec.html#LimitCPU=)
2. Set systemd to auto restart the FPM process: Restart=always
3 (optional but recommended): run more than one FPM instance and use nginx as a balancer so that if one fails there's more left.

This will mean if it does crash or start gobbling RAM it'll restart.

Edit: can someone send me the file? I'll create a marketing web site for it "phpb0rk" and make £50k from selling it to some terrorists in NK  :-DD :-DD
Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 09:32:37 am
Quote
This will mean if it does crash or start gobbling RAM it'll restart.

Why do you think the site didn't die? Solutions/protections for these issues are already in place. It doesn't however stop a bunch of people consuming all available PHP processes because of a "slow page load" hitting refresh.
Title: Re: Server Error Reports
Post by: bd139 on September 01, 2020, 09:39:40 am
Well it's hard to debug from the outside. I'm pissing in the dark here :-DD

Add more cycles is about all you can do then.
Title: Re: Server Error Reports
Post by: magic on September 01, 2020, 09:55:53 am
I did a quick test on a Debian 10 system with PHP 7.3.19. Not sure how to test libdg version, I don't have root on that box and can't find a file like that in /usr/lib.

Code: [Select]
<?php
$i
=imagecreatefrompng("test.bmp");
for(;;);
?>

PHP Warning:  imagecreatefrompng(): 'test.bmp' is not a valid PNG file in
Standard input code on line 2
^C
Memory usage didn't increase at all after hitting CTRL+D to execute the typed code. Maybe I need some special BMP file, maybe it's fixed in this version.
Memory usage did increase a few megs if I used frombmp instead or converted the file to PNG.

So dunno, check if everything is up to date and pray that there are no serious vulns in there, I guess.
Title: Re: Server Error Reports
Post by: bd139 on September 01, 2020, 10:01:03 am
It's probably a broken BMP file that just happens to skip whatever validation is. It might even be intentionally malformed. I hope your FPM is running as an unprivileged process  :popcorn:

To note libgd has a hell of a lot of CVEs against it which are similar: https://www.cvedetails.com/vulnerability-list/vendor_id-6668/Libgd.html (https://www.cvedetails.com/vulnerability-list/vendor_id-6668/Libgd.html)
Title: Re: Server Error Reports
Post by: magic on September 01, 2020, 10:02:21 am
Well, I could try to upload my test.bmp here as killeevblog.png and see what happens :-DD
Title: Re: Server Error Reports
Post by: bd139 on September 01, 2020, 10:06:16 am
 :-DD

Really to debug this we'd need:

1. PFP FPM version
2. OS version
3. Libgd version
4. Exploding BMP of doom.
5. Probably about 3 hours of pain

Title: Re: Server Error Reports
Post by: gnif on September 01, 2020, 10:11:56 am
Quote
1. PFP FPM version
2. OS version
3. Libgd version
4. Exploding BMP of doom.
5. Probably about 3 hours of pain

Not going to happen for obvious reasons.

Please though stop posting about this here as this topic is special and I am alerted to responses to this topic. It's intended for actual outage reports.
Title: Re: Server Error Reports
Post by: mansaxel on September 01, 2020, 10:45:57 am
Yup,

Issue fixed, another windows bitmap uploaded with a png extension. SMF goes nuts trying to load it and just hangs consuming tons of RAM.

Code: [Select]
FILE(1)                   BSD General Commands Manual                  FILE(1)

NAME
     file -- determine file type

<snip>

     The magic tests are used to check for files with data in particular fixed
     formats.  The canonical example of this is a binary executable (compiled
     program) a.out file, whose format is defined in <elf.h>, <a.out.h> and pos-
     sibly <exec.h> in the standard include directory.  These files have a
     ``magic number'' stored in a particular place near the beginning of the file
     that tells the UNIX operating system that the file is a binary executable,
     and which of several types thereof.  The concept of a ``magic'' has been
     applied by extension to data files.  Any file with some invariant identifier
     at a small fixed offset into the file can usually be described in this way.
     The information identifying these files is read from the compiled magic file
     /usr/share/file/magic.mgc, or the files in the directory
     /usr/share/file/magic if the compiled file does not exist.

<snip>

HISTORY
     There has been a file command in every UNIX since at least Research Version
     4 (man page dated November, 1973). 


Why does SMF degrade itself to using MS-DOS heuristics, when this is and has been available for some time?
Title: Re: Server Error Reports
Post by: joeqsmith on November 14, 2020, 11:46:41 pm
In the last few days I have notices that some PNG files captured with snippet fail security.  It seems to be hit and miss.   

Title: Re: Server Error Reports
Post by: jchw4 on November 22, 2020, 09:33:14 am
One of my JPGs failed security test too.
Could somebody explain what it means?

Upd: It's interesting that recoding it into .png did not help.

Upd1: Switching off "Progressive JPEG" option did help  :)
Title: Re: Server Error Reports
Post by: McBryce on November 22, 2020, 10:54:14 am
I've found that all pictures saved with the 64bit version of irfanview fail, but if I save them using Photoshop or MSPaint they get through.

McBryce.
Title: Re: Server Error Reports
Post by: SilverSolder on November 22, 2020, 01:46:57 pm

Just wait till the security software gets smart enough to actually look at the pictures!  :D
Title: Re: Server Error Reports
Post by: Yansi on November 22, 2020, 04:27:10 pm
Just wanted to let you know and confirm the above, there seems to be a bug in the "attachment security check", as now out of nowhere, some JPG files seems to be failing the check. And nothing has changed on my software side of things for years, I still use the same software to process JPG (or any) mages. Yet now they seem to fail randomly. And I am pretty sure, the file is clean of any kind of malicious sh!t.
Title: Re: Server Error Reports
Post by: McBryce on November 22, 2020, 05:40:45 pm
Yes, but it's not just this forum. Other forums that use the same software are experiencing the same issue.

McBryce.
Title: Re: Server Error Reports
Post by: tggzzz on November 22, 2020, 06:12:58 pm

Just wait till the security software gets smart enough to actually look at the pictures!  :D

I thought all that mattered was how much pink there is in the pictures.

Quote from: Terry Pratchett, The Colour of Magic
The box said, "It's no good. I've run out of pink."

A hitherto unnoticed door opened in front of his eyea. A small, green and hideously warty humanoid figure leaned out, pointed at a colour-encrusted palette in one clawed hand, and screamed at him.

"No pink, See?" screeched the homunculus."No good you going on pressing the lever when there's no pink, is there? If you wanted pink you shouldn't of took all those pictures of young ladies, should you? It's monochrome from now on, friend. Alright?"
Title: Re: Server Error Reports
Post by: bd139 on November 22, 2020, 06:15:44 pm

People will just upload smurf porn instead.
Title: Re: Server Error Reports
Post by: StillTrying on December 21, 2020, 05:36:11 pm
Login password failed twice, even though I'd made the characters visible. :-//

Checked there were only the two failed login emails, came back and then the same EEV password worked. :-//

Is it just me. :)
Title: Re: Server Error Reports
Post by: Vince on December 23, 2020, 08:23:47 pm
Hi,

Sorry if this isn't the place to post this, but it's by far the best I can find...

I am having problems attaching pictures to my topics.

Had the problem for the first time a few days ago. Took a few pics in a row of the setup on my workbench, repairing a CD player, so all pics are technically identical : dimensions, file format (JPG) , compression ratio etc.. only the data / contents of the pictures change. Yet, some pictures will upload just fine, but some will not. No matter how many times I try... it just refuse to attach them. It uploads them, but once uploaded I guess it runs some clever AI to "look" at the pictures... and decides it doesn't like that particular pic, and returns the following message :



Code: [Select]
" Your attachment has failed security checks and cannot be uploaded. Please consult the forum administrator ".

"failed SECURITY checks " ?!  :o  How dangerous and threatening can a broken 30 year old CD player be ?! .................

The latest failure was a few minutes ago, tried to upload a screenshot of my oscilloscope to show a waveform :

https://www.eevblog.com/forum/repair/vintage-cd-player-repair-philips-cdc-486-6-disc-changer/msg3383122/#msg3383122 (https://www.eevblog.com/forum/repair/vintage-cd-player-repair-philips-cdc-486-6-disc-changer/msg3383122/#msg3383122)

Would love to attach the picture for you to look at it, run whatever test on it to see what triggers the server, but of course can't attach it, chicken and egg !  :P

Tried to fool the server by changing the file extension fro PG to HEX, hoping that would keep it from being "analyzed" but no luck, even as  hex file it gives the same error message...

I guess I could send it to directly via e-mail to bypass the forum, if you have one you are willing to trust a random user with ?  I am not a spam robot, I swear...  ;D

Hoping this temperamental behaviour can be fixed, not being able to upload pictures reliably on a forum in 2020 feels rather weird  :(

Regards,

Vince
Title: Re: Server Error Reports
Post by: Vince on December 23, 2020, 08:41:36 pm
Found a work-around, so here goes the offending picture... what's wrong with it ?


I converted it from JPG to PNG and the forum accepts it now. However this is not a "solution" because the file size goes up by a factor of 10 or so, no less. That's unacceptable  :(



Title: Re: Server Error Reports
Post by: SilverSolder on December 23, 2020, 09:23:44 pm
Found a work-around, so here goes the offending picture... what's wrong with it ?


I converted it from JPG to PNG and the forum accepts it now. However this is not a "solution" because the file size goes up by a factor of 10 or so, no less. That's unacceptable  :(

Maybe you can zip the offending JPEG file and attach?
Title: Re: Server Error Reports
Post by: Vince on December 23, 2020, 09:28:02 pm
Yes that's an idea ! Let's try that... it worked !  :D
Title: Re: Server Error Reports
Post by: SilverSolder on December 23, 2020, 10:00:08 pm
Yes that's an idea ! Let's try that... it worked !  :D

 :-+

There have been other reports of JPEGs getting flagged for security issues.  Wonder if this is just some kind of anti-virus fingerprinting snafu?
Title: Re: Server Error Reports
Post by: McBryce on December 24, 2020, 10:01:49 am
This has something to do with the Forum software being used, because I get that issue on another Forum too that uses the same software. I've found that certain programs cause the issue. If I save a jpg with Irfanview 64 they often get rejected. If I save the same picture using MSPaint the error goes away.

McBryce.
Title: Re: Server Error Reports
Post by: beanflying on December 24, 2020, 10:10:14 am
Using the same version of Irfanview for the last year+ and same issue with me and JPG's in the last week so yep PNG's to solve this bug. I suspect it is a permissions issue with maybe a new release or a new version of a mod that Dave has installed that needs a tweak.
Title: Re: Server Error Reports
Post by: floobydust on December 27, 2020, 10:51:10 pm
I keep getting the "Your attachment has failed security checks and cannot be uploaded. Please consult the forum administrator.", then the Modify Message goes into a coma.
But weird- it's even for .jpg's that are already posted a year or more ago, same file. Only the Russian hackers are embedding badness in jpg's.

edit I have a pic "34470a ref.jpg" successfully uploaded in 2017 at https://www.eevblog.com/forum/metrology/ultra-precision-reference-ltz1000/msg1315334/#msg1315334 (https://www.eevblog.com/forum/metrology/ultra-precision-reference-ltz1000/msg1315334/#msg1315334)
that lately won't upload without the error message. I tried a few times to upload it here in this post and it failed, then it's working fine. UGH
Title: Re: Server Error Reports
Post by: bd139 on December 27, 2020, 11:18:46 pm
Had the same. Given up  :-//
Title: Re: Server Error Reports
Post by: MK14 on December 31, 2020, 12:32:44 am
I'm sometimes intermittently getting, the following:
(At a VERY approximate rate, of 1 in every 10 Forum page accesses).

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

E.g. About 1 minute ago. 12:31 AM UK time.
Which in UTC is:

Quote
00:31
Thursday, 31 December 2020
Coordinated Universal Time (UTC)

(Yes, identical, at this time of year).
Title: Re: Server Error Reports
Post by: tautech on December 31, 2020, 12:39:35 am
Me too and Quote doesn't work.  :-//

In some thread thumbnails are not loading yet the link for them is there.  :-//

Maybe SMF has got on the happy new year juice a bit early.  :-DD
Title: Re: Server Error Reports
Post by: tautech on December 31, 2020, 09:25:19 am
Me too and Quote doesn't work.  :-//

In some thread thumbnails are not loading yet the link for them is there.  :-//

Maybe SMF has got on the happy new year juice a bit early.  :-DD
Forum can be a right PITA with these connection issues.
Somethings not right.   :horse:
Title: Re: Server Error Reports
Post by: bd139 on December 31, 2020, 10:19:21 am
Yeah getting irritating now. Have multiple persistent issues now.

https://youtu.be/ps28uqkfsUw
Title: Re: Server Error Reports
Post by: gnif on December 31, 2020, 10:37:37 pm
Can someone please provide one of the offending files so I can investigate? Seems SMF added some very primitive and poorly implemented security checking code for infected files.

Code: [Select]
preg_match('~(iframe|\\<\\?|\\<%|html|eval|body|script\W|[CF]WS[\x01-\x0C])~i', $prev_chunk . $cur_chunk) === 1)
The final match in this is likely to trigger on tons of stuff, a very dumb move.

Edit:

I have re-written the check logic, it should be far more reliable and also yield better protection. This should also stop people from being able to upload forum breaking images.
Test images attached :)
Title: Re: Server Error Reports
Post by: beanflying on December 31, 2020, 11:02:14 pm
Formerly Failed Jpeg. Dropbears are a real threat.  >:D

Unless you changed something Gnif this same picture was failing the security check last time I tried it as a jpeg so???

Edit of my edit  :-+ seems to be ok again then - good work  :)
Title: Re: Server Error Reports
Post by: gnif on December 31, 2020, 11:16:05 pm
I'm sometimes intermittently getting, the following:
(At a VERY approximate rate, of 1 in every 10 Forum page accesses).

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

E.g. About 1 minute ago. 12:31 AM UK time.
Which in UTC is:

Quote
00:31
Thursday, 31 December 2020
Coordinated Universal Time (UTC)

(Yes, identical, at this time of year).

I resolved this last night, the 'thanks' plugin was at fault, it generates the `'top 10` stats in a very very poor way for the forum stats page and was bogging the database down. I don't think whoever wrote that plugin had forums the size of EEVBlog in mind. For now (perhaps forever) I have disabled the code causing the issue, as such the top 10 is blank now.
Title: Re: Server Error Reports
Post by: tautech on December 31, 2020, 11:23:27 pm
Certainly the Stats page loads in an instant now whereas before the sever always took some time to think about it.

Good job gnif !  :clap:
Title: Re: Server Error Reports
Post by: bd139 on December 31, 2020, 11:31:48 pm
Big improvement. Nice one  :-+
Title: Re: Server Error Reports
Post by: tautech on January 01, 2021, 12:00:00 am
Now the only real nuisance that needs attention is the first attachment in a reply when for some reason another attachment you've previously uploaded gets added to your post instead of the one you wanted.  :-//

For some time we've been skipping the 1st attachment and only using 2nd and subsequent which results in bypassing this problem.  :phew:
Title: Re: Server Error Reports
Post by: Vince on January 01, 2021, 02:06:38 am
I have re-written the check logic, it should be far more reliable and also yield better protection. This should also stop people from being able to upload forum breaking images.
Test images attached :)

Wow, thanks a lot !  :-+

Glad to see there is someone here that knows this forum stuff, well done  :)
Title: Re: Server Error Reports
Post by: mnementh on January 01, 2021, 02:24:48 am
*Airmails gnif a New Year's toast*

Thanks!

mnem
:clap:
Title: Re: Server Error Reports
Post by: gnif on January 01, 2021, 03:49:45 am
Now the only real nuisance that needs attention is the first attachment in a reply when for some reason another attachment you've previously uploaded gets added to your post instead of the one you wanted.  :-//

For some time we've been skipping the 1st attachment and only using 2nd and subsequent which results in bypassing this problem.  :phew:

I have some time today to try to track this one down.... see what bad thing SMF did to break this too :(
Title: Re: Server Error Reports
Post by: tautech on January 01, 2021, 05:49:12 am
Now the only real nuisance that needs attention is the first attachment in a reply when for some reason another attachment you've previously uploaded gets added to your post instead of the one you wanted.  :-//

For some time we've been skipping the 1st attachment and only using 2nd and subsequent which results in bypassing this problem.  :phew:

I have some time today to try to track this one down.... see what bad thing SMF did to break this too :(
IIRC it was associated with a plugin that gave problems and Dave disabled. That also killed the pic insertion feature so everyone had to go back to using IMG flags.
Not such a problem for those of us that have been around here for a few years where it was just standard practice.

Maybe a few pages back in this thread you can find Daves comments and actions about this.
Title: Re: Server Error Reports
Post by: gnif on January 01, 2021, 08:28:56 am
We must be thinking about different issues then, I am talking about the one where the full size image gets replaced by a future image post. My investigation points to an issue with GlusterFS.
Title: Re: Server Error Reports
Post by: gnif on January 01, 2021, 01:47:24 pm
Sorry about the short outage people, doing some quite extensive server upgrades to allow us to upgrade GlusterFS

Edit: Please be aware that this is still in progress, minor interruptions are to be expected
Title: Re: Server Error Reports
Post by: gnif on January 02, 2021, 05:56:42 am
Work has been completed, if there are any further issues please as usual post the details here and I will do what I can :)
Title: Re: Server Error Reports
Post by: S. Petrukhin on January 02, 2021, 07:10:20 pm
We must be thinking about different issues then, I am talking about the one where the full size image gets replaced by a future image post. My investigation points to an issue with GlusterFS.
Is this fixed yet?
Title: Re: Server Error Reports
Post by: RoGeorge on January 02, 2021, 07:18:25 pm
I didn't noticed any downtime, but right now each page has a terrible slow response.  It takes 2-3 seconds to return a page.  The pages were loading without any noticeable lag in the previous days.

Browsing from Bucharest/Romania/EU.  Other sites are working just fine, only EEVblog takes many seconds to return a forum page.
Title: Re: Server Error Reports
Post by: PA0PBZ on January 02, 2021, 07:21:44 pm
It was quite slow for me until yesterday but it's all good now. YMMV of course.
Title: Re: Server Error Reports
Post by: SilverSolder on January 02, 2021, 08:42:39 pm

I am also seeing slow page response times on initial load.
Title: Re: Server Error Reports
Post by: PA0PBZ on January 02, 2021, 08:46:12 pm
Yeah, never post 'all good now' because after that it slowed down again  :(
Title: Re: Server Error Reports
Post by: gnif on January 02, 2021, 11:05:37 pm
We must be thinking about different issues then, I am talking about the one where the full size image gets replaced by a future image post. My investigation points to an issue with GlusterFS.
Is this fixed yet?

It should be, time will tell.


I am also seeing slow page response times on initial load.

Performance metrics show the website is loading about 5% faster then prior to the upgrade, it's likely due to your geographical location.
Title: Re: Server Error Reports
Post by: RoGeorge on January 03, 2021, 12:17:17 am
The speed seems back to normal right now.  The lag is gone, thanks.
Title: Re: Server Error Reports
Post by: S. Petrukhin on January 03, 2021, 11:00:41 am
Another small bug: it seems that if the user did not specify the country, the place of the flag is displayed crookedly.
[attachimg=1]
Title: Re: Server Error Reports
Post by: S. Petrukhin on January 03, 2021, 11:02:46 am
And I still can't attach the inserted full-size image. See previous post: I specified inline full-size, but it still inserts as a tumb.
Title: Re: Server Error Reports
Post by: gnif on January 03, 2021, 11:06:53 am
Neither of which are server issues but rather quirks of SMF sorry.
Title: Re: Server Error Reports
Post by: PA0PBZ on January 03, 2021, 11:09:09 am
And I still can't attach the inserted full-size image. See previous post: I specified inline full-size, but it still inserts as a tumb.

The plugin was disabled, the options still show but they do nothing. I think it was disabled in search of the mysterie picture swapping.
If it stays disabled it would be best to remove the options too.
Title: Re: Server Error Reports
Post by: gnif on January 03, 2021, 11:11:17 am
And I still can't attach the inserted full-size image. See previous post: I specified inline full-size, but it still inserts as a tumb.

The plugin was disabled, the options still show but they do nothing. I think it was disabled in search of the mysterie picture swapping.
If it stays disabled it would be best to remove the options too.

I will suggest to Dave to re-enable it as I am pretty confident it was not the cause.
Title: Re: Server Error Reports
Post by: S. Petrukhin on January 03, 2021, 11:24:14 am
And I still can't attach the inserted full-size image. See previous post: I specified inline full-size, but it still inserts as a tumb.

The plugin was disabled, the options still show but they do nothing. I think it was disabled in search of the mysterie picture swapping.
If it stays disabled it would be best to remove the options too.

But I can see how other users display full-screen images...
Title: Re: Server Error Reports
Post by: S. Petrukhin on January 03, 2021, 11:27:01 am
Neither of which are server issues but rather quirks of SMF sorry.

Can someone fix this? It seems to me that there is simply no file 00.gif in the directory with flags.  :)
Title: Re: Server Error Reports
Post by: gnif on January 03, 2021, 11:29:43 am
Neither of which are server issues but rather quirks of SMF sorry.

Can someone fix this? It seems to me that there is simply no file 00.gif in the directory with flags.  :)

You're posing into `Server Error Reports`, not `Forum Error Reports`. I am the server admin, not forum admin, this is up to Dave
Title: Re: Server Error Reports
Post by: PA0PBZ on January 03, 2021, 11:31:27 am
But I can see how other users display full-screen images...

Attach the image to your post and save, then copy the link for the full-sized image, edit your post and put the link between img tags.
Anyway, this thread is not for this stuff, so I will not post more. If you can't work it out ask in general.
Title: Re: Server Error Reports
Post by: RoGeorge on January 06, 2021, 10:32:01 am
Not really an error, but it is very slow and very laggy again.  Text is reasonably OK, but pics are unusable slow to me.

Took about 10-20 seconds to open the two attachments here https://www.eevblog.com/forum/metrology/software-for-automated-testing-(scpi)/msg3402554/#msg3402554 (https://www.eevblog.com/forum/metrology/software-for-automated-testing-(scpi)/msg3402554/#msg3402554) (less than 200k).

This happens only with EEVblog forum, other websites are as snappy as last year.   :-//

Happens with all the pics, these took 3-5 seconds to open each:
https://www.eevblog.com/forum/testgear/rigol-dsxxxx-gel-firmware-file-format/msg3402398/#msg3402398 (https://www.eevblog.com/forum/testgear/rigol-dsxxxx-gel-firmware-file-format/msg3402398/#msg3402398)

Even the forum elements, like the black grid with circles background seems slow, in the sense that it feels like the page is waiting for them.
Title: Re: Server Error Reports
Post by: gnif on January 06, 2021, 10:35:02 am
Loading extremely fast for me, and I am not local (AU vs US) to the server. Local route or ISP issue for you sorry.
Title: Re: Server Error Reports
Post by: RoGeorge on January 06, 2021, 11:18:40 am
I'm seeing a lot of weird "pagespeed" URL's, don't know if a week or so ago, when the forum was working great, was the same.

https://stackoverflow.com/questions/13113383/weird-pagespeed-url-for-png-image

Already deleted all caches and cookies, and it is as bad as before deletion.
Does by any chance Google Pagespeed was somehow turned on this year?  Usually browsing from a desktop with latest Kubuntu/Firefox.

Just tested moments ago with Pale Moon, and EEvblog forum is almost unusable, will install just for a quick test Chromium...
Title: Re: Server Error Reports
Post by: gnif on January 06, 2021, 11:20:34 am
I'm seeing a lot of weird "pagespeed" URL's, don't know if a week or so ago, when the forum was working great, was the same.

https://stackoverflow.com/questions/13113383/weird-pagespeed-url-for-png-image

Already deleted all caches and cookies, and it is still very bad.
Does by any chance Google Pagespeed was somehow turned on this year?  Usually browsing from a desktop with latest Kubuntu/Firefox.

Just tested moments ago with Pale Moon, and EEvblog forum is almost unusable, will install just for a quick test Chromium...

We have had pagespeed installed and active on the server for well over 2 years now. This is not the cause of any issues you are having. I collect performance metrics from 4 countries every 2 minutes across all of Dave's cluster, at current, there is not, nor has there been any degradation in performance and all pages are rendering correctly. If you are experiencing issues it is on your end.
Title: Re: Server Error Reports
Post by: Ranayna on January 06, 2021, 01:50:44 pm
For what it's worth: The forum was really slow for me intermittently today as well. At the moment it's better, but still somewhat slow.

EDIT: Debatable whether this is a server issue or a forum issue  :-//

What i see in the network tab of Chrome, is that mainly external stuff takes long to load. The main culprit seems to be supplyframe.com. Almost all requests to them take 500 to 1000 miliseconds to load, and there are quite a few of them.
Title: Re: Server Error Reports
Post by: gnif on January 06, 2021, 03:33:02 pm
EDIT: Debatable whether this is a server issue or a forum issue  :-//

It is not debatable, I have metrics to prove that the server is operating within norms and there are no slow requests. Complaints of slow image loading (static files) can ONLY be attributed to a network issue between the user and the server. If it were the server I would have multiple alarms as these servers are actively monitored for such issues.
Title: Re: Server Error Reports
Post by: Ranayna on January 06, 2021, 04:16:46 pm
I apologize if my report is not in the proper thread. But there is no other one that i am aware of where forum issues can be reported. And as a user it is not always easy to be aware if whatever issue is occuring is a server or forum issue. Mostly, from the user side, these are synonymous.
Title: Re: Server Error Reports
Post by: beanflying on February 03, 2021, 02:41:32 am
Hey Gnif,

can you take a look at the server load? Getting some slow load times (not always) and a few database not found issues (seemingly random once or twice in the last few days).

keep up the good work  :-+
Title: Re: Server Error Reports
Post by: SilverSolder on February 03, 2021, 03:17:06 am
EDIT: Debatable whether this is a server issue or a forum issue  :-//

It is not debatable, I have metrics to prove that the server is operating within norms and there are no slow requests. Complaints of slow image loading (static files) can ONLY be attributed to a network issue between the user and the server. If it were the server I would have multiple alarms as these servers are actively monitored for such issues.

I'm having a lot of issues with slow DNS responses around here.  That can make the network seem slow, even though it isn't...
Title: Re: Server Error Reports
Post by: RoGeorge on February 14, 2021, 10:49:59 pm
Some unexpected logouts and session expire is happening
https://www.eevblog.com/forum/supporters-lounge/unexpected-password-change/ (https://www.eevblog.com/forum/supporters-lounge/unexpected-password-change/)
Title: Re: Server Error Reports
Post by: jmelson on February 15, 2021, 03:11:43 am
I'm getting 502 Bad Gateway errors only on the Manufacturing and Assembly forum today.  I cleared my cache, no difference.

Any idea what is wrong?

Thanks,

Jon
Title: Re: Server Error Reports
Post by: tautech on February 15, 2021, 04:17:04 am
Other Equipment & Products also 502
Title: Re: Server Error Reports
Post by: tautech on February 15, 2021, 10:58:07 am
RF, Microwave, Ham Radio too !
Title: Re: Server Error Reports
Post by: jmelson on February 15, 2021, 03:51:46 pm
RF, Microwave, Ham Radio too !
Yup, I confirm, RF, Manufacturing and Other Equipment all get the 502 error, now.

I hope somebody can get this fixed. 

Jon
Title: Re: Server Error Reports
Post by: jmelson on February 15, 2021, 07:08:39 pm
I'm getting 502 Bad Gateway errors only on the Manufacturing and Assembly forum today.  I cleared my cache, no difference.

Any idea what is wrong?

Thanks,

Jon
Now it is happening on :
Beginners
Manufacturing
RF
Other Equipment

forums, and I get the same pattern on a second computer, so it is not some weird cache issue.  I hope this can be fixed easily.

Thanks,

Jon
Title: Re: Server Error Reports
Post by: tautech on February 15, 2021, 07:41:42 pm
And another....when looking for a thread back a few pages in the TE board more than a few pages back returned 502's.  :-//
Title: Re: Server Error Reports
Post by: richnormand on February 15, 2021, 09:21:20 pm
Same issue at this end (Ontario, Canada).....
Title: Re: Server Error Reports
Post by: mskeete on February 15, 2021, 09:48:39 pm
Using my mobile phone, If I turn off "desktop site" then I can get into the M&A section.
As soon as I tick that setting again (as that's how I normally have it set) then the 502 error is back
Title: Re: Server Error Reports
Post by: jmelson on February 16, 2021, 01:40:12 am
Using my mobile phone, If I turn off "desktop site" then I can get into the M&A section.
As soon as I tick that setting again (as that's how I normally have it set) then the 502 error is back
Is there an equivalent to this setting on a destop/laptop  running Firefox?
Title: Re: Server Error Reports
Post by: tautech on February 16, 2021, 01:55:17 am
Using my mobile phone, If I turn off "desktop site" then I can get into the M&A section.
As soon as I tick that setting again (as that's how I normally have it set) then the 502 error is back
Is there an equivalent to this setting on a destop/laptop  running Firefox?
Right at the bottom of this page on the gray background in blue print. Last line second link from right goes to the Mobile view. Works fine in Chrome.
Title: Re: Server Error Reports
Post by: jmelson on February 16, 2021, 02:36:44 am
Using my mobile phone, If I turn off "desktop site" then I can get into the M&A section.
As soon as I tick that setting again (as that's how I normally have it set) then the 502 error is back
Is there an equivalent to this setting on a destop/laptop  running Firefox?
Right at the bottom of this page on the gray background in blue print. Last line second link from right goes to the Mobile view. Works fine in Chrome.
Wow, that blue text totally disappears on the perforated metal grille background, I had to use ctrl/A to see it.  Yes, that DOES make the 502 forums work, but they sure are ugly in that mode.  Well, this revelation should help the powers that be figure out what is going on.
Thanks!

Jon
Title: Re: Server Error Reports
Post by: MK14 on February 16, 2021, 02:51:34 am
There is a (horrible) workaround.

E.g. For this which gives 502:
https://www.eevblog.com/forum/manufacture/ (https://www.eevblog.com/forum/manufacture/)

If you get the 502 error, instead, click on the first available topic/thread, which is shown on the headings page, towards the top half of the main page.

E.g. It currently is, this, which works:

https://www.eevblog.com/forum/manufacture/first-pcb-hasl-smeared-design-error-or-manufacturing-defect/msg3467117/#new (https://www.eevblog.com/forum/manufacture/first-pcb-hasl-smeared-design-error-or-manufacturing-defect/msg3467117/#new)

You can then (painfully, goto the next one, and the next one ........
By clicking on 'next' in the botton right of the page, in a tiny font.

https://www.eevblog.com/forum/manufacture/first-pcb-hasl-smeared-design-error-or-manufacturing-defect/?prev_next=next#new (https://www.eevblog.com/forum/manufacture/first-pcb-hasl-smeared-design-error-or-manufacturing-defect/?prev_next=next#new)

Also, above information, may help narrow the fault diagnosis.
Title: Re: Server Error Reports
Post by: MK14 on February 16, 2021, 03:12:30 am
Not sure why, the 502 errors, sometimes clears itself up. E.g. Beginners now works.

Wondered if it was because of new threads.

So, tried creating a new thread, but no, it doesn't clear the 502 server error.

https://www.eevblog.com/forum/manufacture/test-502/msg3467133/#new (https://www.eevblog.com/forum/manufacture/test-502/msg3467133/#new)
Title: Re: Server Error Reports
Post by: beanflying on February 16, 2021, 04:02:21 am
Gnif hasn't been on since before the first report of this. Has anyone dropped him or Dave a message or email?
Title: Re: Server Error Reports
Post by: nuclearcat on February 16, 2021, 04:14:08 am
I just did in twitter, hopefully he will notice. Manufacturing dead for a while.
I hope Gnif is ok.
Title: Re: Server Error Reports
Post by: gnif on February 16, 2021, 06:04:26 am
The forum upgrade required that peope re-login, it was expected I am sorry.
The bug preventing some pages to load was due to an SMF error during the upgrade where a table column was not renamed correctly.
Title: Re: Server Error Reports
Post by: RoGeorge on February 16, 2021, 12:45:38 pm
Can the timeout for composing a reply be increased please?

Each time I spend more then a few minutes while editing a reply, I get a red bar when pressing submit, saying the session expired and I need to press submit again.  On the second submit it works.  I'm logged in permanently, with the "remember me" option checked.

Never had this warning bar before the upgrade.
Title: Re: Server Error Reports
Post by: jmelson on February 16, 2021, 05:09:00 pm
The forum upgrade required that peope re-login, it was expected I am sorry.
The bug preventing some pages to load was due to an SMF error during the upgrade where a table column was not renamed correctly.
Thanks so much for tracking it down and fixing it!

Jon
Title: Re: Server Error Reports
Post by: StillTrying on February 18, 2021, 11:20:40 pm
Each time I spend more then a few minutes while editing a reply, I get a red bar when pressing submit, saying the session expired and I need to press submit again.  On the second submit it works.

Clicking [Preview] occasionally probably resets the editing timer, because I take ages and I've not seen that, yet. :-\
Title: Re: Server Error Reports
Post by: StillTrying on February 22, 2021, 09:41:51 pm
Login password failed twice, even though I'd made the characters visible. :-//
Is it just me. :)

Now 6 tries to login, reset the PW, and then a wait because it was locked. :palm:
Title: Re: Server Error Reports
Post by: RoGeorge on April 08, 2021, 03:12:52 pm
From the other topic I understand the current setup after the fire is not final, so this is just FYI, not a complaint.

- From here many pages (about 1 out of 10 clicks or so) return "502 Bad Gateway nginx" at the first click.  At a second try or after an F5 page refresh, it works.
- Pages are much slower than before the fire.
Title: Re: Server Error Reports
Post by: dcac on April 08, 2021, 11:27:48 pm
I realize we're not yet fully up and running. But just FYI I'm having strange problems staying logged in - I just made a post in this thread: https://eevblog.com/forum/testgear/hantek-cc-65-acdc-current-probe-teardown-and-testing/ (https://eevblog.com/forum/testgear/hantek-cc-65-acdc-current-probe-teardown-and-testing/)

And it went fine - but if I now enters that thread again I immediately get logged out - if I log back in I get directed to here: https://www.eevblog.com/forum/testgear/?wwwRedirect (https://www.eevblog.com/forum/testgear/?wwwRedirect)

Entering any other thread seems to work fine. I tried deleting my cookies for EEVBlog - but that did not change any thing.

Also if I deliberately jump between those two url's - I'm showed as logged out in the cc-65 thread but as logged in the other and as it seems most other threads too.

UPDATE: after making this post I rechecked the behavior and it's still the same. However I can enter this thread without any problems and i.e. make this update to my post.

UPDATE-2: If I now try to log in while I'm in the cc-65 thread I get this error:
Code: [Select]
An Error Has Occurred!
Unable to verify referring url. Please go back and try again.
Title: Re: Server Error Reports
Post by: RoGeorge on April 08, 2021, 11:57:15 pm
I can enter to that topic just fine, but only if I manually insert WWW into the URL.

with www
https://www.eevblog.com/forum/testgear/hantek-cc-65-acdc-current-probe-teardown-and-testing/ (https://www.eevblog.com/forum/testgear/hantek-cc-65-acdc-current-probe-teardown-and-testing/)
- I can see it as a logged user

without www
https://eevblog.com/forum/testgear/hantek-cc-65-acdc-current-probe-teardown-and-testing/ (https://eevblog.com/forum/testgear/hantek-cc-65-acdc-current-probe-teardown-and-testing/)
- I can see it as a not logged visitor, even if I am logged into the www version
- if I return to a page starting with www, I am still logged into www.eevblog.com/forum (https://www.eevblog.com/forum)

Looks to me like the login from "WWW.eevblog.com" is not valid in "eevblog.com".
The WWW address is working just fine for me.  I didn't try to log into 'eevblog.com', since I am usually using the www prefix.

Why are you trying to use the address without the leading www?
Title: Re: Server Error Reports
Post by: dcac on April 09, 2021, 12:13:53 am
Thanks for testing.

I entered the thread from my usual bookmark which has the leading WWW. I didn't realize that had disappeared when I then maneuvered between the links.

But I think I've solved it now. In Firefox I've now used 'Forget about this site' on (www).eevblog - interestingly after that the cc-65 thread was still present in my history - likely as you pointed out it was missing the WWW - so I used forget about those links too and now after logging in everything seems to be working fine. And when using my same old bookmark the www now remains in the links.
Title: Re: Server Error Reports
Post by: tautech on April 09, 2021, 01:08:14 am
Possibly another little server problem in that email notification of PM's does not seem to be working.  :-//

Normally email notification of PM's is almost instant.......unless Gmail has some problem.

Anyone else seeing this ?
Title: Re: Server Error Reports
Post by: xrunner on April 09, 2021, 01:10:29 am
Possibly another little server problem in that email notification of PM's does not seem to be working.  :-//

Normally email notification of PM's is almost instant.......unless Gmail has some problem.

Anyone else seeing this ?

Yes I am.
Title: Re: Server Error Reports
Post by: tautech on April 09, 2021, 02:12:50 am
Possibly another little server problem in that email notification of PM's does not seem to be working.  :-//

Normally email notification of PM's is almost instant.......unless Gmail has some problem.

Anyone else seeing this ?

Yes I am.
:-DD
Yes your PM arrived without email notification which had me wondering and it might seem like my reply didn't get to your email either.
Poor gnif....isn't it like he has enough to do already !
Title: Re: Server Error Reports
Post by: beanflying on April 09, 2021, 03:33:40 am
Likely will need to reconfigure SMF as it treats the email notifications on the periphery so depending on where it was pointed to send from likely tweakage needed. I had a major  |O when I set up an SMF forum in the past on AWS because of this. So anyone suggesting Amazon as the solution here consider yourself pre :horse:
Title: Re: Server Error Reports
Post by: EEVblog on April 09, 2021, 05:44:58 am
Likely will need to reconfigure SMF as it treats the email notifications on the periphery so depending on where it was pointed to send from likely tweakage needed. I had a major  |O when I set up an SMF forum in the past on AWS because of this. So anyone suggesting Amazon as the solution here consider yourself pre :horse:

Anyone else seeing a broken Thanks button?

(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1209419;image)
Title: Re: Server Error Reports
Post by: beanflying on April 09, 2021, 06:27:50 am
Likely will need to reconfigure SMF as it treats the email notifications on the periphery so depending on where it was pointed to send from likely tweakage needed. I had a major  |O when I set up an SMF forum in the past on AWS because of this. So anyone suggesting Amazon as the solution here consider yourself pre :horse:

Anyone else seeing a broken Thanks button?

(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1209419;image)

Only related to time out issues I think. Took maybe 10 seconds to get it done  |O
Title: Re: Server Error Reports
Post by: Cerebus on April 09, 2021, 08:15:03 am
Likely will need to reconfigure SMF as it treats the email notifications on the periphery so depending on where it was pointed to send from likely tweakage needed. I had a major  |O when I set up an SMF forum in the past on AWS because of this. So anyone suggesting Amazon as the solution here consider yourself pre :horse:

Anyone else seeing a broken Thanks button?

(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1209419;image)

My brain initially parsed that screenshot as saying "There was an error while thinking" - there are posts of mine where I could have made good use of that button. New feature request?  :)

And I could "thank" your message without any problems, and withdraw it without any problems.

Or are you just trawling for a little bit of extra approval after a hard week?  :)
Title: Re: Server Error Reports
Post by: MK14 on April 09, 2021, 01:34:00 pm
Likely will need to reconfigure SMF as it treats the email notifications on the periphery so depending on where it was pointed to send from likely tweakage needed. I had a major  |O when I set up an SMF forum in the past on AWS because of this. So anyone suggesting Amazon as the solution here consider yourself pre :horse:

Anyone else seeing a broken Thanks button?

(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1209419;image)

No, seems to be working just fine.

It always (for me), did that "error while thanking" thing, around 5% to 15%, of the time BEFORE the disaster/fire/reconstruction. But I just assumed it was an occasional poor connection on my part, or somewhat rare/minor problem with the EEVblog server.
Title: Re: Server Error Reports
Post by: bd139 on April 09, 2021, 03:50:53 pm
Yeah was always borked randomly.

Also "insert quote" appears to periodically not do anything at the moment since the outage as well.
Title: Re: Server Error Reports
Post by: AlfBaz on April 09, 2021, 10:38:42 pm
Working fine here but its always displayed exactly that on the mobile version of the site
Title: Re: Server Error Reports
Post by: EEVblog on April 11, 2021, 05:24:32 am
FYI, new account activation emails and moderator report email seems to be down due to the private network in the datacentre not back online yet. No ETA for that yet.
Title: Re: Server Error Reports
Post by: tautech on April 11, 2021, 05:25:48 am
FYI, new account activation emails and moderator report email seems to be down due to the private network in the datacentre not back online yet. No ETA for that yet.
PM emails not working either.
Title: Re: Server Error Reports
Post by: T3sl4co1l on April 12, 2021, 04:49:36 pm
Been getting session timeouts on reply -- think this was a setting, maybe just wasn't reloaded properly?

Tim
Title: Re: Server Error Reports
Post by: gnif on April 13, 2021, 12:04:40 am
Until we get both servers back up we will continue to see such issues. GorillaServers did upgrade our hardware as part of the restoration however we are still operating on a single server, and the setup is not tuned to take advantage of the higher performance processors. I am continuing to tune the setup however we have to be careful to not overload the single server (process/memory exhaustion) as doing so would cause things to exponentially slow down. Each setting tweak needs 24 hours of verification through server metrics to ensure that during peak loads (Lunch in the US) we don't exceed the server's capabillity.
Title: Re: Server Error Reports
Post by: SilverSolder on April 13, 2021, 12:48:25 am

I've noticed significantly better performance today, overall.  Looks like recovery is under way!
Title: Re: Server Error Reports
Post by: gnif on April 13, 2021, 12:54:29 am
Unfortunately not yet, this is a result of server tuning :)
Title: Re: Server Error Reports
Post by: gnif on April 14, 2021, 01:34:11 pm
Another outage! Looks like power to BOTH of the current working EEVBlog servers was interrupted. Waiting for GS to explain this one.

https://twitter.com/HostFission/status/1382325389813485570

Edit: Multiple reports on WebHostingTalk of others experiencing the same issue, servers powered off and needing to be manually turned back on via IPMI, etc... No news from GS on the cause yet though.
Title: Re: Server Error Reports
Post by: SilverSolder on April 14, 2021, 02:41:34 pm

I guess that after the backup generator burned, they are vulnerable to external power interruptions?
Title: Re: Server Error Reports
Post by: Bud on April 14, 2021, 02:47:33 pm
Another outage! Looks like power to BOTH of the current working EEVBlog servers was interrupted. Waiting for GS to explain this one.

https://twitter.com/HostFission/status/1382325389813485570

 :-//
Title: Re: Server Error Reports
Post by: tautech on April 19, 2021, 01:01:10 am
Forum PM email notification now working.  :)
Title: Re: Server Error Reports
Post by: EEVblog on April 19, 2021, 01:13:58 am
Forum PM email notification now working.  :)

Yep, we had to revert back to the forum email system directly. So this may result in some systems detecting it as spam. But at least it's all working again  :phew:
Title: Re: Server Error Reports
Post by: tautech on April 19, 2021, 01:16:24 am
Is there still some unsolved performance/speed issues Dave ?
Forum seems pretty snappy again.
Title: Re: Server Error Reports
Post by: EEVblog on April 19, 2021, 01:47:05 am
Is there still some unsolved performance/speed issues Dave ?
Forum seems pretty snappy again.

The redundant server box still isn't fully operational.
Title: Re: Server Error Reports
Post by: RoGeorge on April 27, 2021, 02:32:16 pm
Just FIY, not a big deal, but there is a bug I don't recall seeing it before:

- test between the "code" tags is supposed to remain verbatim, as typed, however
- if there is an URL address inside the "code" section, an "URL" tag is inserted automatically
- even when the message is edited again to manually remove the "url" tags, the "url" tag will appear again when published

For example, in this post https://www.eevblog.com/forum/fpga/arrow-deca-max-10-board-for-$37/msg3558204/#msg3558204 (https://www.eevblog.com/forum/fpga/arrow-deca-max-10-board-for-$37/msg3558204/#msg3558204) the url and slash url inside the "code" section were not added by me, then deleted, yet still there.   :)
Title: Re: Server Error Reports
Post by: RoGeorge on April 27, 2021, 02:41:26 pm
While reporting the above bug, just stepped into another url related bug.   :-DD

- url addresses containing the $ char in the url will result in a broken link, like this
https://www.eevblog.com/forum/fpga/arrow-deca-max-10-board-for- (https://www.eevblog.com/forum/fpga/arrow-deca-max-10-board-for-)$37/msg3558204/#msg3558204

instead of this (manually added an empty url then pasted the url once after url = and once between the url open and close tag, for the display name:
https://www.eevblog.com/forum/fpga/arrow-deca-max-10-board-for-$37/msg3558204/#msg3558204 (https://www.eevblog.com/forum/fpga/arrow-deca-max-10-board-for-$37/msg3558204/#msg3558204)
Title: Re: Server Error Reports
Post by: tautech on May 02, 2021, 07:39:30 pm
FORUM BUG
Threads and posts are disappearing !

Has the forum been compromised/hacked ?

Then I find this on Discord:  :o
(https://media.discordapp.net/attachments/662871717667930142/838397721513427004/unknown.png?width=933&height=459)

And that thread is gone walkabout too !
Title: Re: Server Error Reports
Post by: Whales on May 02, 2021, 10:09:52 pm
Server has been restored from dayish-old backup:  https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/ (https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/)
Title: Re: Server Error Reports
Post by: EEVblog on May 03, 2021, 10:04:16 am
Server has been restored from dayish-old backup:  https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/ (https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/)

Yes, and as a result some posts in the last day or so will have been lost unfortunately.
Title: Re: Server Error Reports
Post by: mnementh on May 06, 2021, 07:41:38 pm
As if you guys didn't already have enough to deal with... I was just curious how eevBlog/SMH is supposed to handle animated GIFs now.

It used to be, I could attach animated GIFs along with a post without issue, as long as they were small enuf. If a GIF was too large, I'd resize it using one of the online GIF editors, save it to my machine and then attach it. Never had any problems doing this; even with transparent background GIFs.

Ever since shortly after eevBlog was infested with the pic-eating random wandering singularity (https://www.eevblog.com/forum/chat/website-error-reports/msg3186064/#msg3186064), ;) any animated GIF I attach does not seem to work properly; they don't actually animate, and transparent ones appear with a black background. ???

Pre-existing ones attached prior to that event all seem to work fine; transparency, animation all perfectly normal.

It's obviously not a high priority... I just wondered if there was an extension or add-on that was supposed to handle this sort of stuff which had been disabled, either accidentally or on purpose, or whatever.  :-//

Cheers,

mnem
(https://filedn.com/lEDSGUXnO7mp9lWR3BbARrR/Emoticons/coffee_L.gif)
Title: Re: Server Error Reports
Post by: bd139 on May 06, 2021, 08:20:53 pm
dlattach is not sending animated gifs down. Only first frame by the looks.

This is one reason I usually use imgur. 

Also the attachment previews take bloody forever to load so when there are quite a few attachments in a post the page slowly loads like it's on dialup.

One day in the distant future someone will write some forum software that isn't a pile of excrement. So far the human race has not succeeded :-DD
Title: Re: Server Error Reports
Post by: mnementh on May 06, 2021, 11:04:45 pm
I get that; except we have lots of posts where somebody links to something offsite and the vagaries of the internet break the pic. I have dozens of posts on IMGUR that no longer point to the correct URL, and we won't talk aboot my PhotoBuckethole PITAs...

As a result, for the last year or two I try to make sure the attachments are actually right there with the post... so that even when I'm gone, future readers won't be going "WFT wazzat a-hole talkin' aboot...?" because the attachment vaporized.

There will still be plenty of "WFT wazzat a-hole talkin' aboot...?" because of the "content", I'm sure, but at least the "content" will be there.  :-DD

mnem
*mal-content*
Title: Re: Server Error Reports
Post by: bd139 on May 07, 2021, 06:48:54 am
Imgur has been ok for me. Haven’t seen anything disappear into a void yet.  :-//
Title: Re: Server Error Reports
Post by: mnementh on May 07, 2021, 07:17:35 pm
You're still alive, and your UMGUR account still active. How it was explained to me was that when you don't post anything new for a while and nobody replies to your stuff, your account goes inactive and is transferred to their secondary/long-term servers and that can cause some links to break.

Consider the average age of those in the TEA thread, for example; that attrition rate immediately becomes a concern.

mnem
 :popcorn:
Title: Re: Server Error Reports
Post by: bd139 on May 07, 2021, 07:32:56 pm
I post all my stuff on imgur anonymously.

I get your point though. One reason I want to do a proper archive job. Everything be it internal to the forum or external to it has the same archive priority.
Title: Re: Server Error Reports
Post by: RoGeorge on May 07, 2021, 07:38:40 pm
"This site can't be reached" error:
https://www.eevblog.com/forum/beginners/forum-problems-when-postingediting/msg3565152/#msg3565152 (https://www.eevblog.com/forum/beginners/forum-problems-when-postingediting/msg3565152/#msg3565152)
Title: Re: Server Error Reports
Post by: Anthocyanina on May 07, 2021, 07:50:03 pm
Was told it would be a good idea to post this kind of error here, so i'm pasting my post from the beginners section (I didn't know where else to post when i did)
Is anyone else having this issue? I haven't been able to consistently post/edit my posts lately. i get this error a lot. I've already tried on different computers and on different networks and i get this same error  :scared:

Edit: found out it's been happening a lot more often when trying to attach more than one file at once, just had to edit a post attaching 1 file each time for it to work. trying to attach two or more files would result in the error
Title: Re: Server Error Reports
Post by: Yansi on May 09, 2021, 10:34:09 am
Well, for the last like at least three days, the  eevblog server is more inaccessible than accessible.  Maybe that has something to do with it? Now it is working again - at least now.
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 10:36:23 am
Well, for the last like at least three days, the  eevblog server is more inaccessible than accessible.  Maybe that has something to do with it? Now it is working again - at least now.

If you are experiencing outages/issues, please report them. Server monitoring has not reported any issues over the last few days except for the outage today that was caused by the hosting provider.
Title: Re: Server Error Reports
Post by: Ed.Kloonk on May 09, 2021, 10:42:25 am
What ever happened to good ole five nines uptime?
Title: Re: Server Error Reports
Post by: Yansi on May 09, 2021, 10:43:37 am
I thought this was another major outage you probably know well about, so I did not want to bother with "hey, it is not working again".

I have just checked couple hours ago, it was still inaccessible and using this page: https://www.isitdownrightnow.com/eevblog.com.html (https://www.isitdownrightnow.com/eevblog.com.html) it showed  "down for 4 days 18hrs" which about corresponded to what I was (not) getting here.

But I am not sure how can I help further to troubleshoot stuff like this. If it happens next time, is there anything I can do to help you solve it?
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 10:48:13 am
> "down for 4 days 18hrs" which about corresponded to what I was (not) getting here.

The server's IP was null routed, which may have taken longer for us to detect due to route caching... but 4 days does seem a bit excessive so I am not sure what was going on there sorry.

If you have issues accessing the website, please screenshot and post here (if you can), if not you can DM @HostFission on Twitter with the report and I will investigate.
Title: Re: Server Error Reports
Post by: woofy on May 09, 2021, 11:34:06 am
My last post was at 6:30pm yesterday and I've had no further access until a few minutes ago, 12:30pm UK time. No error messages, just DNS timeout.
This feels like a DNS propagation delay. Did you update pointers?
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 11:38:08 am
The outage today was due to a disgruntled nutjob abusing AbuseIPDB to report Dave's youtube videos as "Web Spam" and then using this to report Dave's IPs to GorillaServers as being abusive, which caused them to null route our IPs.
Title: Re: Server Error Reports
Post by: SilverSolder on May 09, 2021, 12:23:12 pm
The outage today was due to a disgruntled nutjob abusing AbuseIPDB to report Dave's youtube videos as "Web Spam" and then using this to report Dave's IPs to GorillaServers as being abusive, which caused them to null route our IPs.

It is really pretty sad that they just take anyone's word for it and pull the plug...

Courts (and the entire legal system) were invented to adjudicate disputes in a fair and lawful manner, using laws put in place by democratic means.   The Internet is still a bit of a jungle in this respect...
Title: Re: Server Error Reports
Post by: magic on May 09, 2021, 12:46:03 pm
gnif: Off-topic content removed
Title: Re: Server Error Reports
Post by: beanflying on May 09, 2021, 12:59:46 pm
gnif: Off-topic content removed
Title: Re: Server Error Reports
Post by: PlainName on May 09, 2021, 01:01:43 pm
Well, for the last like at least three days, the  eevblog server is more inaccessible than accessible.  Maybe that has something to do with it? Now it is working again - at least now.

If you are experiencing outages/issues, please report them. Server monitoring has not reported any issues over the last few days except for the outage today that was caused by the hosting provider.

How does one report issues if eevblog is uncontactable?

FWIW, it's been down for me for a couple of days too. And all the 'is it just me' and 'is it really down' tools reported eevblog was actually down for everyone, too.
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 01:03:20 pm
Dude, justice existed for millennia without idiocracy and it better stay that way. The last thing we need is disputes between websites and mad Chinese users resolved by some international UN body filled with "experts" from CCP and all the other crazies out there.

Not necessarily defending the actions of the commercial players currently in charge, but really, be careful what you wish for.

Totally off-topic, continue this discussion here at your own peril.
Title: Re: Server Error Reports
Post by: xrunner on May 09, 2021, 01:04:54 pm
The outage today was due to a disgruntled nutjob abusing AbuseIPDB to report Dave's youtube videos as "Web Spam" and then using this to report Dave's IPs to GorillaServers as being abusive, which caused them to null route our IPs.

I'm sure Greater Minds than mine know what to do, but if the guy is abusing the reporting system then seems he/she should be reported ...  :-//
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 01:06:33 pm
Not an open invitation to just spam, but if the site is truly down and you can't post on here and you're certain it's not an issue on your end, you can DM HostFission on Twitter (link in signature)
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 01:08:24 pm
The outage today was due to a disgruntled nutjob abusing AbuseIPDB to report Dave's youtube videos as "Web Spam" and then using this to report Dave's IPs to GorillaServers as being abusive, which caused them to null route our IPs.

I'm sure Greater Minds than mine know what to do, but if the guy is abusing the reporting system then seems he/she should be reported ...  :-//

Indeed, we are already pursuing avenues with regard to this. We know who the person is, and have enough evidence (The abuse report was even PGP signed, lol) to take things further if needed.
Title: Re: Server Error Reports
Post by: rsjsouza on May 09, 2021, 01:16:38 pm
If the disgruntled user was from a few years ago, it is quite ingenuous given that normally all defenses are lowered as time goes by.

In any case, congratulations to gnif, Dave and the other hidden actors for maintaining such incredible website running with great availability for the past several years.
Title: Re: Server Error Reports
Post by: sandalcandal on May 09, 2021, 01:20:51 pm
Dude, justice existed for millennia without idiocracy and it better stay that way. The last thing we need is disputes between websites and mad Chinese users resolved by some international UN body filled with "experts" from CCP and all the other crazies out there.

Not necessarily defending the actions of the commercial players currently in charge, but really, be careful what you wish for.

I'm not sure the full details are to be made public, so I'm surprised gnif has said as much however this particular case has nothing to do with any Chinese users disgruntled or otherwise. As gnif said, in this case it was a (non-Chinese) nutjob not some CCP conspiracy.
Title: Re: Server Error Reports
Post by: PlainName on May 09, 2021, 01:22:08 pm
Quote
you can DM HostFission on Twitter

I'll try and remember that, but you're up so reliably there's usually no need to bother. Maybe if you threw a wobbly a bit more often that'd get written down somewhere...
Title: Re: Server Error Reports
Post by: DrG on May 09, 2021, 01:55:55 pm
The outage today was due to a disgruntled nutjob abusing AbuseIPDB to report Dave's youtube videos as "Web Spam" and then using this to report Dave's IPs to GorillaServers as being abusive, which caused them to null route our IPs.

I'm sure Greater Minds than mine know what to do, but if the guy is abusing the reporting system then seems he/she should be reported ...  :-//

Indeed, we are already pursuing avenues with regard to this. We know who the person is, and have enough evidence (The abuse report was even PGP signed, lol) to take things further if needed.

It seems bizarre. I looked at those "reports" just now and nothing is clear to me at all. The abuse site says "Confidence of Abuse is 4%". Looks like once or twice a week a report was made. HostFission  just posted (an hour ago) that ..."This information was cited as a reason to have the @eevblog
 server's IPs null routed by the datacenter who obliged."

It seems bizarre because there does not seem to be any "due process" or "due diligence". Granted, I may be missing more than I am getting, but it still seems bizarre. If you can say...is this a technicality, an absurd process with little or no false reporting consequences or something else?
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 02:16:12 pm
Dave did get a copy of the abuse report which got lost among other emails, there was an opportunity to contest it. The thing is that it shouldn't have even got that far, and I should have also got a copy as I am Dave's Technical contact. At the end of the day, there were mistakes made by all parties involved.

If you have a dig through the reports listed as "Web Spam" by that user you will find he is attacking multiple youtubers, including Fran. He is an utter scumbag.
Title: Re: Server Error Reports
Post by: bd139 on May 09, 2021, 02:26:27 pm
Yes definitely shouldn’t have got that far.

Well so far they tried to burn the hardware, then wet it then shoot it after a malicious report.

They don’t deserve to have customers.

This is one thing I love about AWS. They call us if there’s an issue and talk to someone before doing anything.
Title: Re: Server Error Reports
Post by: wilfred on May 09, 2021, 03:05:41 pm
Dave did get a copy of the abuse report which got lost among other emails, there was an opportunity to contest it. The thing is that it shouldn't have even got that far, and I should have also got a copy as I am Dave's Technical contact. At the end of the day, there were mistakes made by all parties involved.

If you have a dig through the reports listed as "Web Spam" by that user you will find he is attacking multiple youtubers, including Fran. He is an utter scumbag.
I tried to look at what you're referring to. It looked to me like that person had made over 26,000 reports (I could be wrong) which is a lot of work. It seemed like it might be automated.

What is "Web Spam"? Most of the reports listed "email spam".
Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 03:14:54 pm
It is very likely automated to an extent. The user clearly has a grudge though and is also making manual submissions for youtubers. Normally "Web Spam" would be a bot that was caught posting spam to a website.
Title: Re: Server Error Reports
Post by: DrG on May 09, 2021, 03:21:03 pm
Enter eevblog.com and I see 28 reports (all from the same source). All are categorized as "web spam" except for the last six which are listed in the email spam category. I did not look at every one, but the ones that I did see (expand the comment section and it ends with a link that I assume is the object of the report) link to YouTube videos and just normal eevblog videos...nothing looks like my definition of spam. Even the email spam category entries that I looked at, link to youtube vids.

Additionally, while from other threads, I know that the YouTube "regs" are "artistic" to be kind, I am not sure what is being reported there that should not be reported to YouTube, if there is anything to report - which again, is not at all clear to me...or to put it simply..."what??? why is that spam???".



Title: Re: Server Error Reports
Post by: gnif on May 09, 2021, 03:32:24 pm
Exactly the issue, the user is abusing the submission API to report abuse based on YouTube videos. If there is a problem with YouTube video it must be reported to YouTube, not a third party IP that has nothing to do with it (from a hosting perspective)
Title: Re: Server Error Reports
Post by: bitseeker on May 09, 2021, 04:30:35 pm
Ugh, I feel your pain, gnif & Dave. Try to do good in the world and the nut jobs come out in force. What nonsense.

Thanks for your continued perseverance.
Title: Re: Server Error Reports
Post by: StillTrying on May 09, 2021, 10:41:23 pm
Some say the site was unavailable for 3 or 4 days, it seemed more like 24 hours to me.

The May stats don't show much of a gap.
https://www.eevblog.com/forum/stats/ (https://www.eevblog.com/forum/stats/)
Title: Re: Server Error Reports
Post by: tautech on May 09, 2021, 10:56:44 pm
Some say the site was unavailable for 3 or 4 days, it seemed more like 24 hours to me.

The May stats don't show much of a gap.
https://www.eevblog.com/forum/stats/ (https://www.eevblog.com/forum/stats/)
~16 actually if we can go by the most active thread on the forum:
https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3565691/#msg3565691 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg3565691/#msg3565691)
Title: Re: Server Error Reports
Post by: bd139 on May 10, 2021, 06:52:46 am
Best way of working this out is a tool called AWS CloudWatch Synthetics. You can set it up to do a typical user journey every 10 minutes ie log in, open a thread etc. If anything doesn’t work it’ll keep availability stats and send alert emails etc. $5 a month for a 10 minute cycle approx.

Here’s what poked me yesterday
Title: Re: Server Error Reports
Post by: gnif on May 10, 2021, 01:49:12 pm
We keep detailed metrics of the servers, here is the logged outage period.

Title: Re: Server Error Reports
Post by: bd139 on May 10, 2021, 03:33:27 pm
Nice. That'll give you a machine level outage / traffic outage. The synthetics will tell you the forum is throwing 500 errors as well i.e. what does it look like from the end user's perspective.
Title: Re: Server Error Reports
Post by: bitseeker on May 14, 2021, 07:33:57 am
First time I've gotten this error:

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

Occurred about a minute ago. The post I submitted was still saved, though. :-//
Title: Re: Server Error Reports
Post by: tautech on May 14, 2021, 07:38:41 am
First time I've gotten this error:

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

Occurred about a minute ago. The post I submitted was still saved, though. :-//
Sporadically had this too since the server was last down. Posting or viewing.
Title: Re: Server Error Reports
Post by: sandalcandal on May 14, 2021, 08:07:31 am
First time I've gotten this error:

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

Occurred about a minute ago. The post I submitted was still saved, though. :-//
Sporadically had this too since the server was last down. Posting or viewing.
+1 also having this issue sporadically
Title: Re: Server Error Reports
Post by: RoGeorge on May 14, 2021, 08:54:51 am
First time I've gotten this error:

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

Occurred about a minute ago. The post I submitted was still saved, though. :-//
Sporadically had this too since the server was last down. Posting or viewing.
+1 also having this issue sporadically
Just seen this error, too.
Title: Re: Server Error Reports
Post by: YetAnotherTechie on May 24, 2021, 11:06:35 pm
Have you seen: https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/125/ (https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/125/) ?
I still don't get anything from eevblog on my hotmail account.
Title: Re: Server Error Reports
Post by: EEVblog on June 01, 2021, 11:15:18 am
First time I've gotten this error:

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

Occurred about a minute ago. The post I submitted was still saved, though. :-//
Sporadically had this too since the server was last down. Posting or viewing.

I believe we are still running on a single server box since the fire.
Title: Re: Server Error Reports
Post by: gnif on August 27, 2021, 02:07:04 am
Just an update on the above..

We are fully operational on two servers again and have been for a little bit now. :)
Title: Re: Server Error Reports
Post by: tautech on August 27, 2021, 05:13:06 am
Just an update on the above..

We are fully operational on two servers again and have been for a little bit now. :)
:-//
A day, a week or a month ?
Yet it seems we still have some issues with server overloads ....at least at my end when connection fails.

What to the logs look like ?
Title: Re: Server Error Reports
Post by: RoGeorge on August 27, 2021, 05:59:51 am
That's great, thank you!  :)

May I kindly ask if we can have a preview that renders math formulas (at preview time, before pressing Post).  Right now the preview does not render the graphic form for math formulas.  I can see the drawn equations only after pressing Post, which is cumbersome when there is more complicated formulas to write.

Example:
Code: [Select]
Write a line of text with the inline formula \$ a = b + c \$, or a formula in display mode (aka single line centered formula)\[ x = y + z \] The formulas will only appear rendered in their graphical form only after posting the message, but not at preview.
Write a line of text with the inline formula \$ a = b + c \$, or a formula in display mode (aka single line centered formula)\[ x = y + z \] The formulas will only appear rendered in their graphical form only after posting the message, but not at preview.

This is not a critical bug, but rather a nice to have, and only if it doesn't mess anything else.




For now (if that helps debugging) I've found a workaround:
- press Reply to get to the edit post page
- save the Reply page on disk (from the web browser, mine is Firefox ESR)
- click to open in another browser tab the saved page from the local disk
- edit the reply text and the formula in the tab that was opened from the local disk
- press Preview in the tab opened from the local disk, this will show a "live" preview coming from EEVblog, a preview with the formulas rendered   ;D
- at another press of the preview (from the "live" page), the formulas will not be rendered
- now, if I want to make further edits, I press "back" in the browser, so to arrive again at the reply page that was opened from local disk, edit and press preview again, that will open again a preview coming from the EEVblog (including rendered formulas) and so on
- once the reply text and all formulas are OK in the reply tab that was opened from the local disk, press "Post".
 :phew:
Title: Re: Server Error Reports
Post by: gnif on August 27, 2021, 01:54:11 pm
Just an update on the above..

We are fully operational on two servers again and have been for a little bit now. :)
:-//
A day, a week or a month ?
Yet it seems we still have some issues with server overloads ....at least at my end when connection fails.

What to the logs look like ?

About a week now of stable uptime.
Servers are monitored 24x7 for overload scenarios and we are not even close.
Connection failures are not server overload issues, more likely a routing issue to the server.

That's great, thank you!  :)

May I kindly ask if we can have a preview that renders math formulas (at preview time, before pressing Post).  Right now the preview does not render the graphic form for math formulas.  I can see the drawn equations only after pressing Post, which is cumbersome when there is more complicated formulas to write.

Off topic, this is "Server Error Reports"

Title: Re: Server Error Reports
Post by: RoGeorge on August 27, 2021, 03:43:36 pm
True that, but they are all servers, the hosting/hardware server, the database server that keeps all the messages, the web server serving the SMF pages, etc.   :)

Is there any SMF Plugins Error Reports thread, or feature request thread?
Title: Re: Server Error Reports
Post by: YetAnotherTechie on August 27, 2021, 04:05:28 pm
Have you seen: https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/125/ (https://www.eevblog.com/forum/news/news-forum-reverted-to-backup/125/) ?
I still don't get anything from eevblog on my hotmail account.
I'd like to point out that notifications started showing up again in my hotmail account, beggining in 14 of August.
Title: Re: Server Error Reports
Post by: gnif on August 27, 2021, 04:10:30 pm
True that, but they are all servers, the hosting/hardware server, the database server that keeps all the messages, the web server serving the SMF pages, etc.   :)

Is there any SMF Plugins Error Reports thread, or feature request thread?

You're asking for a feature in a server error reporting thread that is dedicated to this purpose. This thread is special as it alerts me when posted that there might be a server fault I need to investigate.
I suggest you open a new thread asking for such a feature if you desire it, I don't manage the plugins/features on this forum.

I'd like to point out that notifications started showing up again in my hotmail account, beggining in 14 of August.

Good to hear, this was resolved when Gorilla Servers finally brought up our private network again and we were able to route the email through our mail gateways correctly.
Title: Re: Server Error Reports
Post by: RoGeorge on October 29, 2021, 11:27:21 am
Starting this morning, sometimes the pages does not load even after waiting for 30 seconds or so (I'm using mostly the two links in the upper left corner near the avatar, Firefox ESR, Kubuntu).  If I wait for a while then try clicking again, it works.  On my side it seems to be happening with EEVblog only, other websites are responsive.

Anybody else seeing random page loading failures today?
Title: Re: Server Error Reports
Post by: PlainName on October 29, 2021, 11:33:53 am
I keep getting just the plain text for a page, but a refresh usually gets me the proper thing. Doesn't happen too often, and it's been like this for the past couple of days.
Title: Re: Server Error Reports
Post by: gnif on October 29, 2021, 12:33:21 pm
Thanks guys, I will have a dig into it.
Title: Re: Server Error Reports
Post by: PA0PBZ on October 29, 2021, 01:01:59 pm
I noticed that yesterday the .css failed to load, but it just happened once and a refresh solved it.
Title: Re: Server Error Reports
Post by: MrMobodies on December 03, 2021, 09:07:11 pm
I am am not sure if it is a server error or not but just noticed a whole load of forum boards/categories all suddenly disappeared.

EEVBlog specific (disappeared):
EEVdiscover, EEVBlab, Suggestions

Off Topic Hobbies (nothing underneath):
Mechanical Engineering.
3D printing
Cooking
Title: Re: Server Error Reports
Post by: tautech on December 03, 2021, 09:15:45 pm
I am am not sure if it is a server error or not but just noticed a whole load of forum boards/categories all suddenly disappeared.

EEVBlog specific (disappeared):
EEVdiscover, EEVBlab, Suggestions

Off Topic Hobbies (nothing underneath):
Mechanical Engineering.
3D printing
Cooking
Dave's had a rearrange....see here:
https://www.eevblog.com/forum/news/new-off-topic-hobbies-section/msg3848825/#msg3848825 (https://www.eevblog.com/forum/news/new-off-topic-hobbies-section/msg3848825/#msg3848825)
Title: Re: Server Error Reports
Post by: MK14 on December 20, 2021, 08:36:05 pm
On Dec 20th 2021, at around 8:27 PM (UTC and UK time), the Forum server disappeared, completely (including downforjustme or everyone types of tests), for around 5 minutes or so.

(I did not note the exact time, so could be out by a few minutes).

Quote
Down for Everyone or Just Me
Short URL @ 
downfor.io
Eevblog.com Status
Is eevblog.com down right now?
It's not just you! eevblog.com is down.

Title: Re: Server Error Reports
Post by: RoGeorge on December 20, 2021, 09:26:29 pm
Can confirm that, too, but it was only for a very short time.
Probably just a minor version bump that required a server restart...



(https://images.squarespace-cdn.com/content/v1/5355d604e4b03c3e9896e131/108af9dc-b154-4aca-91d5-240d40209e39/image-asset.jpeg)
Source:  https://www.infosecurity.us/blog/2021/12/19/log4j-the-meme-2 (https://www.infosecurity.us/blog/2021/12/19/log4j-the-meme-2)
 ;D
Title: Re: Server Error Reports
Post by: gnif on January 24, 2022, 07:43:35 pm
There was no outage on our end during that period. More likely a down route between you an the server as we were processing requests throughout the reported period without interruption (see attached)
Title: Re: Server Error Reports
Post by: PlainName on January 24, 2022, 08:40:37 pm
I can see the problem. Your local time is "24 January 2022, 20:39:06" and the chart is "2022-01-25-064231".

Title: Re: Server Error Reports
Post by: MK14 on January 24, 2022, 08:45:09 pm
There was no outage on our end during that period. More likely a down route between you an the server as we were processing requests throughout the reported period without interruption (see attached)

Wow. So, because myself, RoGeorge and (presumably) the DownForEveryOne IP checker, perhaps used a common European or other internet route. We all had difficulties getting to EEVblog.com.
That makes sense, as other people who were unaffected, wouldn't know their's was working while ours wasn't. So they wouldn't have reported that it was working at that time, just assumed they weren't using it at that time.
Thanks for results. It didn't occur to me, that multiple people (using the same massive internet routes), could have problems, nothing to do with EEVblog.
Title: Re: Server Error Reports
Post by: MK14 on January 24, 2022, 08:48:38 pm
I can see the problem. Your local time is "24 January 2022, 20:39:06" and the chart is "2022-01-25-064231".

The date, shown in the bottom left hand corner, of the image Gnif has posted, seems to be 20th December 2021, which corresponds to the date of my report.
Title: Re: Server Error Reports
Post by: PlainName on January 24, 2022, 09:12:10 pm
Ah. Old eyes, here.
Title: Re: Server Error Reports
Post by: gnif on January 24, 2022, 09:27:49 pm
Yeah, the filename date is just due to the tool I used to take a screenshot, the range covered is 2021-12-20 to 2021-12-21
Title: Re: Server Error Reports
Post by: MrMobodies on February 09, 2022, 09:22:02 pm
Sorry I am not sure if it is an error but I was looking in the Supporters lounge and noticed this thread that remembered I couldn't find for a while suddenly appearing in there:

Gender politics has now infected engineering as well.
https://www.eevblog.com/forum/supporters-lounge/gender-politics-has-now-infected-engineering-as-well/1800/ (https://www.eevblog.com/forum/supporters-lounge/gender-politics-has-now-infected-engineering-as-well/1800/)

I wonder what happened, was it moved by mistake or were there lots of complaints about it?
Title: Re: Server Error Reports
Post by: gnif on February 09, 2022, 09:45:13 pm
This is server error reports, it might have been moved by a mod, or dave... either way this is not the place to ask. This thread is special and alerts me when people post to it, it's for outages/crashes, it's not for moved posts, etc.
Title: Re: Server Error Reports
Post by: MrMobodies on February 09, 2022, 11:16:58 pm
I am sorry about that, gnif, I forgot and just remembered that was for the Moderation thread (use to be sticky here) that also seems to have gone somewhere.
Title: Re: Server Error Reports
Post by: tautech on February 09, 2022, 11:34:45 pm
I am sorry about that, gnif, I forgot and just remembered that was for the Moderation thread (use to be sticky here) that also seems to have gone somewhere.
Used to be here as a sticky but now unstuck and the only one now not locked.  :(
https://www.eevblog.com/forum/chat/moderation-reports/ (https://www.eevblog.com/forum/chat/moderation-reports/)
Title: Re: Server Error Reports
Post by: RoGeorge on May 13, 2022, 09:11:31 am
Just FYI, since the last 10 hours or so, I can not access eevblog.com from Bucharest/Romania/EU.

However, the "is it down" type of websites show eevblog up all around the world but when I try to traceroute I get this:
Code: [Select]
traceroute eevblog.com
traceroute to eevblog.com (192.154.109.3), 30 hops max, 60 byte packets
 1  _gateway (192.168.100.1)  0.381 ms  0.576 ms  0.750 ms
 2  StamAcasa.rdsnet.ro (10.0.0.1)  5.356 ms  5.435 ms  5.498 ms
 3  10-30-0-65.rdsnet.ro (10.30.0.65)  5.553 ms  5.620 ms  5.701 ms
 4  10.220.153.179 (10.220.153.179)  5.685 ms 10.220.148.208 (10.220.148.208)  16.294 ms static-10-220-131-97.rdsnet.ro (10.220.131.97)  16.373 ms
 5  * * *
 6  * * *
 7  * * *
...
30  * * *

Host eevblog.com returns
Code: [Select]
host eevblog.com
eevblog.com has address 192.154.109.3
eevblog.com has address 192.154.111.219
eevblog.com mail is handled by 0 mail.eevblog.com.

Posted this using Tor browser, so it's using some other route to reach eevblog.  It seems like it's a routing problem on my side, though I've noticed the number of logged users right now (173) is lower than usual.  I suspect a wider area is affected, not just my ISP.  Changing the OS or restarting the router for a new IP doesn't help.

Today is also Friday The 13th  :scared: 
 ;D
Title: Re: Server Error Reports
Post by: gnif on May 13, 2022, 09:13:15 am
Just FYI, since the last 10 hours or so, I can not access eevblog.com from Bucharest/Romania/EU.

However, the "is it down" type of websites show eevblog up all around the world but when I try to traceroute I get this:
Code: [Select]
traceroute eevblog.com
traceroute to eevblog.com (192.154.109.3), 30 hops max, 60 byte packets
 1  _gateway (192.168.100.1)  0.381 ms  0.576 ms  0.750 ms
 2  StamAcasa.rdsnet.ro (10.0.0.1)  5.356 ms  5.435 ms  5.498 ms
 3  10-30-0-65.rdsnet.ro (10.30.0.65)  5.553 ms  5.620 ms  5.701 ms
 4  10.220.153.179 (10.220.153.179)  5.685 ms 10.220.148.208 (10.220.148.208)  16.294 ms static-10-220-131-97.rdsnet.ro (10.220.131.97)  16.373 ms
 5  * * *
 6  * * *
 7  * * *
...
30  * * *

Host eevblog.com returns
Code: [Select]
host eevblog.com
eevblog.com has address 192.154.109.3
eevblog.com has address 192.154.111.219
eevblog.com mail is handled by 0 mail.eevblog.com.

Posted this using Tor browser, so it's using some other route to reach eevblog.  It seems like it's a routing problem on my side, though I've noticed the number of logged users right now (173) is lower than usual.  I suspect a wider area is affected, not just my ISP.  Changing the OS or restarting the router for a new IP doesn't help.

Today is also Friday The 13th  :scared: 
 ;D

No issues our side, as you have noted this is a routing issue and there is nothing here we can do about it.
Title: Re: Server Error Reports
Post by: RoGeorge on November 02, 2022, 02:40:45 pm
Starting this afternoon, I'm seeing 5-10 seconds delay to load a page, from EEVblog only, the very few other forums I use to visit doesn't seem affected.  Before, EEVblog forum pages used to load almost instantly (less than a second or so, never measured), but now I can count to 10-20 and the page still not shown.

Browsing from EU/Bucharest/Romania.

Anybody else seeing 5-10 seconds delay to load the "Show unread posts since last visit." or "Show new replies to your posts." pages, please?


Later edit:
Submitting this post also took 10-20 seconds to upload + display back the posted message.  :-//
Title: Re: Server Error Reports
Post by: RoGeorge on November 02, 2022, 04:29:32 pm
False alarm, sorry.  Went out for groceries, and now it's all OK, as normal again.  :-//
Title: Re: Server Error Reports
Post by: MK14 on November 02, 2022, 04:51:53 pm
False alarm, sorry.  Went out for groceries, and now it's all OK, as normal again.  :-//

Maybe not a false alarm.

I experienced exactly the same, in the last few days or maybe longer.  At the time, other webpages, worked just fine for me.

I didn't report it, in case the issue, was my side.  E.g. A EU wide internet issue.

But it seemed to eventually sort itself out, so I didn't report it.
Title: Re: Server Error Reports
Post by: RoGeorge on November 02, 2022, 05:01:34 pm
For me it was only today, for an hour or two, previous days were OK.  Now it's about normal again, not sure what happened.
Title: Re: Server Error Reports
Post by: Ranayna on November 02, 2022, 10:03:06 pm
Some line seems to have been clogged somewhere :D
I can confirm intermittent long loading times today and yesterday from germany as well.
Title: Re: Server Error Reports
Post by: rsjsouza on November 02, 2022, 10:40:19 pm
[off-topic]
From time to time I still feel amazement at how we nowadays almost take for granted that data traveling for thousands of kilometers has to reach its destination only seconds after it was commanded to be sent.

In Internet's early days, I recall giving a leg up to my data traffic by trace routing the destination IP to help either keep the route alive or eventually capture a slightly more efficient route - back when I browsed with no images and only enabled them when I had reached the page I wanted. This is something unthinkable these days, not only due to the sheer bandwidth available but also to the heavily scripted/crapified web pages with loads of graphical menus and options.
[/off-topic]
Title: Re: Server Error Reports
Post by: gnif on November 02, 2022, 11:21:20 pm
Nothing server side that shows any kind of issue and no latency issues from AU to US. Seems to be an issue with international routing to the server, as such there is nothing we can do about this but wait for it to be resolved.

@rsjsouza please don't post anything off-topic here, this thread is special in that it triggers a monitoring alarm if it sees activity.
Title: Re: Server Error Reports
Post by: PlainName on November 05, 2022, 09:23:07 am
Just had the above reported symptoms. Viewing messages OK and then nothing for a minute, then OK again and a couple minutes later nothing. Once it had frozen and I got my act together (not easy at this time) I grabbed a tracert. This one seems to be down to the UK backbone, but if other countries are getting the same symptoms maybe there's a more global issue that's triggering local problems.
Title: Re: Server Error Reports
Post by: MK14 on November 06, 2022, 03:44:42 pm
3:40 PM UK time (and UTC time is the same at the moment), 6/11/22.

Lots of delay, and lots of error messages (seems to happen on all forum pages):

Quote
502 Bad Gateway
nginx

On all pages, maybe (perhaps) 50% of the time.  I even got one (502), while I tried to get to this posting screen.

Had the problem for around the last twenty minutes.

But had delays, in recent day(s), as well.
Title: Re: Server Error Reports
Post by: RoGeorge on November 06, 2022, 03:49:09 pm
Same from here, very slow loading of 5...10+ seconds per forum webpage, sometimes ending not loading the forum page at all, and showing the "bad gateway nginx" webpage instead.

Later edit:
--------------
Now it's back to normal:  fast pages and no nginx errors  :-//
Title: Re: Server Error Reports
Post by: MK14 on November 06, 2022, 05:00:14 pm
Again I'm getting these intermittent delays (NOW!, UTC almost 5:00 PM).  From around 10 to 50 seconds and sometimes with:

Quote
502 Bad Gateway
nginx

It can be alright for a while (e.g. hours), then starts getting delays again and sometimes these 502's.
Title: Re: Server Error Reports
Post by: MK14 on December 06, 2022, 02:03:43 pm
I'm currently getting massive delays, on most/all features.  So, most/all things take perhaps 10 seconds, maybe longer, to load.
My internet seems fine, but my adblocker, just updated, raising a tiny/small chance it is JUST ME.

It is so bad, I'm having to leave the forum, until it speeds up.

SPECULATION: There seem to have been lots of changes to the forum (software?), recently.  Which might have caused the issue(s).
Title: Re: Server Error Reports
Post by: PA0PBZ on December 06, 2022, 02:08:52 pm
I don't think that the recent changes have anything to do with it, but it is equally slow for me. Opening a thread should not take 15 seconds... Ping times to eevblog.com are a steady 130ms, not sure if that is normal or not, there is however a jump from 10 to 115 ms going from Amsterdam to Cogentco.

Edit: It's now more like 30 seconds :(
Title: Re: Server Error Reports
Post by: gnif on December 06, 2022, 02:10:58 pm
Server performance metrics show all green, access times all green from the AU to the server, no abnormal latency noted.

Edit: testing an update
Title: Re: Server Error Reports
Post by: McBryce on December 06, 2022, 02:25:37 pm
The time needed to update a forum page here (in Germany) at the moment can be measured on a sundial!

McBryce.
Title: Re: Server Error Reports
Post by: gnif on December 06, 2022, 02:33:25 pm
The time needed to update a forum page here (in Germany) at the moment can be measured on a sundial!

McBryce.
Sorry mate, not a server issue our side, must be a connectivity issue on your end.
Title: Re: Server Error Reports
Post by: PA0PBZ on December 06, 2022, 02:40:23 pm

Sorry mate, not a server issue our side, must be a connectivity issue on your end.
Ping times to the server are a stable 130ms from several EU countries (FR, NL, UK) and 160ms from Sidney. It doesn't look like a connectivity issue. However, if you don't seen anything strange on the server there's not much we (you) can do.
Title: Re: Server Error Reports
Post by: Bud on December 06, 2022, 02:42:03 pm
No issues browsing in Toronto Canada.
Title: Re: Server Error Reports
Post by: gnif on December 06, 2022, 02:48:58 pm

Sorry mate, not a server issue our side, must be a connectivity issue on your end.
Ping times to the server are a stable 130ms from several EU countries (FR, NL, UK) and 160ms from Sidney. It doesn't look like a connectivity issue. However, if you don't seen anything strange on the server there's not much we (you) can do.
Ping times are not a good indicator for packet loss, or fragmentation. If you want something somewhat more reliable, use `mtr`
Title: Re: Server Error Reports
Post by: PA0PBZ on December 06, 2022, 03:11:23 pm
Yes. I agree but I used an online tool to check from several locations. MTR shows that there are indeed problems on the last hop before gorilla (38.104.174.42):

|-------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                    |
|                       Host              -   %   | Sent | Recv | Best | Avrg | Wrst | Last |
|-------------------------------------------------|------|------|------|------|------|------|
|                               fritz.box  -    0 |   70 |   70 |    0 |    0 |    0 |    0 |
|                 j139001.upc-j.chello.nl  -    0 |   70 |   70 |    7 |   10 |   23 |    8 |
|                          212.142.51.205  -    0 |   70 |   70 |    7 |   11 |   23 |   11 |
|asd-tr0021-cr101-be112-2.core.as33915.net -    0 |   70 |   70 |    8 |   11 |   23 |    9 |
|    nl-ams14a-ri1-ae51-0.core.as9143.net  -    0 |   70 |   70 |    8 |   12 |   40 |   10 |
|                   No response from host  -  100 |   15 |    0 |    0 |    0 |    0 |    0 |
|  be12265.ccr41.par01.atlas.cogentco.com  -    0 |   70 |   70 |  120 |  123 |  144 |  122 |
|   be3095.ccr41.dca01.atlas.cogentco.com  -    0 |   70 |   70 |  120 |  123 |  140 |  121 |
|   be2891.ccr21.cle04.atlas.cogentco.com  -    0 |   70 |   70 |  120 |  123 |  132 |  122 |
|   be2717.ccr41.ord01.atlas.cogentco.com  -    0 |   70 |   70 |  121 |  132 |  279 |  122 |
|   be2831.ccr21.mci01.atlas.cogentco.com  -    0 |   70 |   70 |  132 |  136 |  154 |  134 |
|   be3035.ccr21.den01.atlas.cogentco.com  -    0 |   70 |   70 |  143 |  147 |  159 |  145 |
|   be3037.ccr21.slc01.atlas.cogentco.com  -    0 |   70 |   70 |  163 |  168 |  189 |  168 |
|                           38.104.174.42  -   34 |   30 |   20 |  174 |  177 |  189 |  175 |
|104-250-157-167.static.gorillaservers.com -    0 |   70 |   70 |  136 |  138 |  147 |  137 |
|192-154-111-219.static.gorillaservers.com -    0 |   70 |   70 |  135 |  139 |  159 |  138 |
|_________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider


Oh well, we have to 'sit it out' I guess.
Title: Re: Server Error Reports
Post by: MK14 on December 06, 2022, 03:17:10 pm

Sorry mate, not a server issue our side, must be a connectivity issue on your end.
Ping times to the server are a stable 130ms from several EU countries (FR, NL, UK) and 160ms from Sidney. It doesn't look like a connectivity issue. However, if you don't seen anything strange on the server there's not much we (you) can do.
Ping times are not a good indicator for packet loss, or fragmentation. If you want something somewhat more reliable, use `mtr`

I've tried mtr on linux, and seem to be getting HUGE packet losses.  The output, is as follows:

                                      My traceroute  [v0.94]
*************** -> www.eevblog.com (http://www.eevblog.com)                                      2022-12-06T15:14:24+0000
Keys:  Help  Display mode  Restart statistics  Order of fields  quit
                                                          Packets              Pings
Host                                                    Loss%  Snt  Last  Avg  Best  Wrst StDev
1. _gateway                                              0.0%    85    3.8  4.0  3.7  6.5  0.5
2. host-***************.net                        0.0%    85  32.5  32.0  31.3  33.7  0.5
3. ae******************.net                          0.0%    85  32.4  32.4  31.5  39.5  1.1
4. ae******************.net                          0.0%    85  32.7  34.8  32.0  69.3  6.2
5. ae******************.net                          0.0%    84  32.8  34.5  32.5  49.3  3.1
6. e0-30.core3.lon1.he.net                              0.0%    84  33.6  33.9  33.0  35.6  0.5
7. 100ge0-75.core3.lon2.he.net                          88.0%    84  72.4  59.7  33.7 146.6  37.4
8. port-channel2.core2.nyc5.he.net                      75.0%    84  102.1 101.1 100.0 104.5  1.1
9. e0-79.core3.nyc4.he.net                              89.2%    84  102.9 101.2 100.2 102.9  1.1
10. port-channel6.core2.mci3.he.net                      85.7%    84  132.6 130.8 126.6 154.1  7.8
11. port-channel2.core3.mci3.he.net                      76.2%    84  128.1 128.4 126.6 142.5  3.8
12. port-channel8.core2.den1.he.net                      88.0%    84  137.0 136.9 136.2 137.8  0.5
13. port-channel10.core2.slc1.he.net                    50.6%    84  147.4 148.5 147.4 153.6  1.2
14. webnx-inc.100gigabitethernet0-25.switch2.slc1.he.net 52.4%    84  185.4 186.4 185.2 188.9  0.8
15. 104-250-156-167.static.gorillaservers.com            42.2%    84  185.9 186.3 185.2 190.4  0.8
16. 192-154-109-3.static.gorillaservers.com              38.1%    84  185.5 185.6 184.5 187.1  0.6
Title: Re: Server Error Reports
Post by: gnif on December 06, 2022, 03:22:56 pm

Sorry mate, not a server issue our side, must be a connectivity issue on your end.
Ping times to the server are a stable 130ms from several EU countries (FR, NL, UK) and 160ms from Sidney. It doesn't look like a connectivity issue. However, if you don't seen anything strange on the server there's not much we (you) can do.
Ping times are not a good indicator for packet loss, or fragmentation. If you want something somewhat more reliable, use `mtr`

I've tried mtr on linux, and seem to be getting HUGE packet losses.  The output, is as follows:

                                      My traceroute  [v0.94]
mx (192.168.0.29) -> www.eevblog.com (http://www.eevblog.com)                                      2022-12-06T15:14:24+0000
Keys:  Help  Display mode  Restart statistics  Order of fields  quit
                                                          Packets              Pings
Host                                                    Loss%  Snt  Last  Avg  Best  Wrst StDev
1. _gateway                                              0.0%    85    3.8  4.0  3.7  6.5  0.5
2. host-62-24-254-204.as13285.net                        0.0%    85  32.5  32.0  31.3  33.7  0.5
3. ae53-ner002.bre.as13285.net                          0.0%    85  32.4  32.4  31.5  39.5  1.1
4. ae53-scr101.loh.as13285.net                          0.0%    85  32.7  34.8  32.0  69.3  6.2
5. ae61-scr101.thw.as13285.net                          0.0%    84  32.8  34.5  32.5  49.3  3.1
6. e0-30.core3.lon1.he.net                              0.0%    84  33.6  33.9  33.0  35.6  0.5
7. 100ge0-75.core3.lon2.he.net                          88.0%    84  72.4  59.7  33.7 146.6  37.4
8. port-channel2.core2.nyc5.he.net                      75.0%    84  102.1 101.1 100.0 104.5  1.1
9. e0-79.core3.nyc4.he.net                              89.2%    84  102.9 101.2 100.2 102.9  1.1
10. port-channel6.core2.mci3.he.net                      85.7%    84  132.6 130.8 126.6 154.1  7.8
11. port-channel2.core3.mci3.he.net                      76.2%    84  128.1 128.4 126.6 142.5  3.8
12. port-channel8.core2.den1.he.net                      88.0%    84  137.0 136.9 136.2 137.8  0.5
13. port-channel10.core2.slc1.he.net                    50.6%    84  147.4 148.5 147.4 153.6  1.2
14. webnx-inc.100gigabitethernet0-25.switch2.slc1.he.net 52.4%    84  185.4 186.4 185.2 188.9  0.8
15. 104-250-156-167.static.gorillaservers.com            42.2%    84  185.9 186.3 185.2 190.4  0.8
16. 192-154-109-3.static.gorillaservers.com              38.1%    84  185.5 185.6 184.5 187.1  0.6

Packet loss starts at hop 7, continues right up to the server. Not an eevblog server issue, please stop posting here now that this has been confirmed. This thread is special and triggers alerts to wake me for issues when it's posted to.
Title: Re: Server Error Reports
Post by: IanB on December 22, 2022, 06:35:36 pm
Suddenly seeing this a lot:

Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.
Title: Re: Server Error Reports
Post by: sokoloff on December 22, 2022, 07:45:57 pm
Same here. 2022-12-22 19:44-19:45 UTC
Title: Re: Server Error Reports
Post by: xrunner on December 22, 2022, 07:47:10 pm
Same here. 2022-12-22 19:44-19:45 UTC

Same here -

Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.
Title: Re: Server Error Reports
Post by: Ed.Kloonk on December 22, 2022, 07:57:42 pm
Me too.
Title: Re: Server Error Reports
Post by: bingo600 on December 22, 2022, 08:09:20 pm
same here

Other thread
https://www.eevblog.com/forum/news/lots-of-smf-database-connection-problems/msg4597778/?topicseen#msg4597778 (https://www.eevblog.com/forum/news/lots-of-smf-database-connection-problems/msg4597778/?topicseen#msg4597778)
Title: Re: Server Error Reports
Post by: SiliconWizard on December 22, 2022, 08:12:09 pm
Keep getting those as well.
Title: Re: Server Error Reports
Post by: gubezon on December 22, 2022, 08:28:45 pm
Getting the database server may be too busy errors here too today. Usually a single page refresh gets it going again.
Title: Re: Server Error Reports
Post by: james_s on December 22, 2022, 08:44:02 pm
I've been getting loads of these today.
Title: Re: Server Error Reports
Post by: AndyBeez on December 22, 2022, 08:55:52 pm
Aw snap :(
Title: Re: Server Error Reports
Post by: tautech on December 22, 2022, 09:11:28 pm
Downunder also.
Title: Re: Server Error Reports
Post by: Infraviolet on December 23, 2022, 12:04:26 am
I've been getting the same error for a while. Saw it some hours ago, each page needs about 3 refreshes before the proepr page appears, and am still having it now.
Title: Re: Server Error Reports
Post by: Psi on December 23, 2022, 12:28:42 am
I'm getting them now as well, not on every page load, just randomly.  Maybe 1 in 5
Title: Re: Server Error Reports
Post by: joeqsmith on January 01, 2023, 12:45:51 am
Photo attachments are having problems again.   The thumbnail is correct but the photo is not.   Seems to happen with drag and drop.   Maybe the same problem as last time.   
Title: Re: Server Error Reports
Post by: james_s on January 11, 2023, 06:52:48 pm
Came here to say this. Sometimes I can see the thumbnail but then I click it and it expands to the wrong photo. Just now I tried to view a photo and got an error that said "You are not allowed to access this section" or something like that.
Title: Re: Server Error Reports
Post by: xrunner on February 02, 2023, 02:37:19 am
Errors this evening in TX, USA

Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

and

404 Not Found

nginx
Title: Re: Server Error Reports
Post by: gnif on February 02, 2023, 03:07:13 am
This was due to some server maintenance that was planned and Dave announced on Twitter. Work has been completed now and services should return to normal.
Title: Re: Server Error Reports
Post by: EEVblog on February 02, 2023, 03:19:09 am
This was due to some server maintenance that was planned and Dave announced on Twitter. Work has been completed now and services should return to normal.

BTW wasn't announced on here because we didn't think it would impact the forum, only the website, but it did. Took the opportunity to upgrade SMF to 2.0.19 as well.
Title: Re: Server Error Reports
Post by: gnif on February 03, 2023, 01:53:04 am
Please be aware that I am commencing work on the servers again and while there should be no interruptions to services, if there is due to unforeseen reasons, I apologize.
Title: Re: Server Error Reports
Post by: timenutgoblin on February 03, 2023, 02:14:58 am
404 Not Found

nginx

I have seen the same error when the forward slash / is omitted from the URL.

The link below takes you to the first page of this thread:
https://www.eevblog.com/forum/chat/website-error-reports/ (https://www.eevblog.com/forum/chat/website-error-reports/)

The link below will give a '404 not found' error:
https://www.eevblog.com/forum/chat/website-error-reports (https://www.eevblog.com/forum/chat/website-error-reports)
Title: Re: Server Error Reports
Post by: gnif on February 03, 2023, 02:17:07 am
404 Not Found

nginx

I have seen the same error when the forward slash / is omitted from the URL.

The link below takes you to the first page of this thread:
https://www.eevblog.com/forum/chat/website-error-reports/ (https://www.eevblog.com/forum/chat/website-error-reports/)

The link below will give a '404 not found' error:
https://www.eevblog.com/forum/chat/website-error-reports (https://www.eevblog.com/forum/chat/website-error-reports)

This is not what this thread is for sorry, though I will investigate when I am done here.
Title: Re: Server Error Reports
Post by: gnif on February 03, 2023, 02:36:52 am
Work has been completed and the trailing slash issue has also been resolved.
Title: Re: Server Error Reports
Post by: davidut5 on March 05, 2023, 07:07:53 am
I get 404 not found when folowing the link in subscription email on android. On windows its fine.
This link for example: https://www.eevblog.com/forum/testgear (https://www.eevblog.com/forum/testgear)
Title: Re: Server Error Reports
Post by: RoGeorge on March 05, 2023, 08:08:49 am
Try adding a slash character at the end, like this
https://www.eevblog.com/forum/testgear/ (https://www.eevblog.com/forum/testgear/)
Title: Re: Server Error Reports
Post by: davidut5 on March 05, 2023, 10:55:06 am
Yeah, now i see the link is folowed partial, could be my email app not liking the $ character?
Title: Re: Server Error Reports
Post by: RoGeorge on March 05, 2023, 11:13:31 am
$ has a special meaning in EEVblog forum.  If you paste the link the URL, the SMF editor will truncate the link, indeed.

If you want to post a link containing a $ character, you have to post it first, then come back and manually edit the link to correct the address, so it will show like this:

https://www.eevblog.com/forum/testgear/ (https://www.eevblog.com/forum/testgear/)$20-lcr-esr-transistor-checker-project/
https://www.eevblog.com/forum/testgear/$20-lcr-esr-transistor-checker-project/ (https://www.eevblog.com/forum/testgear/$20-lcr-esr-transistor-checker-project/)

It's a SMF pitfall in the forum software, preferably to avoid the dollar sign inside any EEVblog titles or URLs.

Anyway, AFAIK this thread is for server down reports only (will send automatic notifications to admins when there is activity here).  Please open a new subject to discuss about any forum's software issues you may found.
Title: Re: Server Error Reports
Post by: beanflying on March 05, 2023, 11:27:55 pm
Sorry for off topic but in SMF use the URL (Insert Hyperlink) button

Code: [Select]
[url]https://www.eevblog.com/forum/testgear/$20-lcr-esr-transistor-checker-project/[/url]

OR if you want it to read nicer

[url=https://www.eevblog.com/forum/testgear/$20-lcr-esr-transistor-checker-project/]$20 LCR ESR transistor checker project/[/url]

This is also a good way to mask really long URL's that also break fairly often because then SMF gets that regardless of characters it is a URL
Title: Re: Server Error Reports
Post by: paulca on March 06, 2023, 05:22:25 pm
I'm seeing a lot of icons disappearing today.  Like all the "New" badges, peoples flags/avatars.

In some cases a CTRL+Refresh works, in many it doesn't.

I expect something has changed and my cache is invalid.
Title: Re: Server Error Reports
Post by: Nominal Animal on March 06, 2023, 05:53:53 pm
I'm seeing a lot of icons disappearing today.  Like all the "New" badges, peoples flags/avatars.
It can also be due to intermediate servers, especially your local ISP, injecting RST packets due to very high local load.

(Once upon a time, they only dropped packets due to congestion, but ever since file sharing, large downloads, and HTTPS (TLS-secured transfers being impossible to peek into by ISPs), at least some ISPs do do that even if it is basically very nasty behaviour.  Browsers see it as a failed transfer, and don't retry.)
Title: Re: Server Error Reports
Post by: Infraviolet on March 06, 2023, 07:07:21 pm
Site partly working for me, but images and graphics missing, basically seeing text only right now.
Title: Re: Server Error Reports
Post by: beanflying on March 07, 2023, 01:01:25 am
Yep embedded images are broken (external using the IMG tag) and internal images are download only and not showing on the forum proper.

I did have an issue on two PC's viewing the site where it seemed to drop some of the CSS images too in particular the 'new' one on the forum index and unread replies.
Title: Re: Server Error Reports
Post by: beanflying on March 07, 2023, 07:46:33 am
Scrap that seems that Adblock Plus and the Top header adclick from doubleclick.net is misbehaving so it is a case of suck up the adds to see the actual forum or linked pics.

Any thoughts on this @Dave?
Title: Re: Server Error Reports
Post by: EEVblog on March 07, 2023, 09:17:06 am
Scrap that seems tht Adblock Plus and the Top header adclick from doubleclick.net is misbehaving so it is a case of suck up the adds to see the actual forum or linked pics.
Any thoughts on this @Dave?

No idea, I don't have ad block.
Title: Re: Server Error Reports
Post by: beanflying on March 07, 2023, 09:22:31 am
No more OT after this I promise Gnif  >:D

Seems AdblockPlus got an 'upgrade' yesterday and is breaking SMF's image handling and CSS so not a site issue  :phew:

Title: Re: Server Error Reports
Post by: Benta on March 08, 2023, 10:45:22 pm
It's not an Adblock issue.
I have the same problem on Brave. Sometimes it's the "Projects" page, sometimes it's the "Beginners", sometimes it's another page.
But it's on/off. Sometimes it's normal, then the icons disappear, a bit later the icons are back, but have disappeared somewhere else...
I thought it was an update running, but after two days I'm no longer certain.
Title: Re: Server Error Reports
Post by: beanflying on March 09, 2023, 12:23:00 am
It's not an Adblock issue.
I have the same problem on Brave. Sometimes it's the "Projects" page, sometimes it's the "Beginners", sometimes it's another page.
But it's on/off. Sometimes it's normal, then the icons disappear, a bit later the icons are back, but have disappeared somewhere else...
I thought it was an update running, but after two days I'm no longer certain.

There is some evidence of cached items blipping in and out from time to time without the filters being changed as most ad blockers just mask items rather than not download them. Discussion in the link here lest we irk GNIF  >:D

https://www.eevblog.com/forum/chat/anyone-else-seeing-small-images-from-forum-not-appearing-i-e-mostly-text-only/ (https://www.eevblog.com/forum/chat/anyone-else-seeing-small-images-from-forum-not-appearing-i-e-mostly-text-only/)

Switched off the bit where EEVBlog was listed in 'Easylist' definitions file and no further issues.
Title: Re: Server Error Reports
Post by: McBryce on March 09, 2023, 08:41:16 am
For the last few days the orange "New" button is missing from the unread threads. Is that just with me or does anyone else miss them too?

McBryce.
Title: Re: Server Error Reports
Post by: T3sl4co1l on March 14, 2023, 01:54:07 pm
For the last few days the orange "New" button is missing from the unread threads. Is that just with me or does anyone else miss them too?

McBryce.

Noticed that too. Seems someone slipped a too-general rule into one of the adblock lists.  For now, if using UBP, add this to your custom filter:

Code: [Select]
[url=http://www.eevblog.com#]www.eevblog.com#[/url]@#[data-pagespeed-url-hash][onload^="pagespeed"]
...Ah found it, it's in EasyList.  Someone want to report it?

Tim
Title: Re: Server Error Reports
Post by: helius on March 19, 2023, 03:49:01 pm
Sorry if there is a more appropriate thread for this.
Can others replicate this image display problem:
https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat)!/msg4764302/#msg4764302
Clicking the thumbnail shows a different image, a SPICE circuit simulation instead of a picture of a cat. Well, maybe the cat isn't so important, but there was a problem years ago with image corruption and it's disturbing if it has returned. If so I think other images will also be affected.
Title: Re: Server Error Reports
Post by: Nominal Animal on March 19, 2023, 05:56:52 pm
Sorry if there is a more appropriate thread for this.
Can others replicate this image display problem:
https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat)!/msg4764302/#msg4764302
Clicking the thumbnail shows a different image, a SPICE circuit simulation instead of a picture of a cat. Well, maybe the cat isn't so important, but there was a problem years ago with image corruption and it's disturbing if it has returned. If so I think other images will also be affected.
Confirmed.  I did see the original cat picture, and it was in my cache, but when I force-reloaded the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) from the server, it was replaced with a SPICE diagram.

To repeat, https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) (IMG_20230316_110455672_HDR.jpg) used to be a JPEG image of a cat on a shelf looking down, but is now a PNG format SPICE diagram.  The cat post involved was not edited.

The poster is the same in both cases.  The original image was attached to this message (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/msg4764302/#msg4764302) (only attachment), and the replacement image attached to this message (https://www.eevblog.com/forum/beginners/resistor-y-junction-calculations/msg4764878/#msg4764878) (first attachment, charger-0v.png).
Title: Re: Server Error Reports
Post by: RoGeorge on March 19, 2023, 06:48:49 pm
Sorry if there is a more appropriate thread for this.
Can others replicate this image display problem:
https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat)!/msg4764302/#msg4764302
Clicking the thumbnail shows a different image, a SPICE circuit simulation instead of a picture of a cat. Well, maybe the cat isn't so important, but there was a problem years ago with image corruption and it's disturbing if it has returned. If so I think other images will also be affected.
Confirmed.  I did see the original cat picture, and it was in my cache, but when I force-reloaded the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) from the server, it was replaced with a SPICE diagram.

To repeat, https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) (IMG_20230316_110455672_HDR.jpg) used to be a JPEG image of a cat on a shelf looking down, but is now a PNG format SPICE diagram.  The cat post involved was not edited.

The poster is the same in both cases.  The original image was attached to this message (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/msg4764302/#msg4764302) (only attachment), and the replacement image attached to this message (https://www.eevblog.com/forum/beginners/resistor-y-junction-calculations/msg4764878/#msg4764878) (first attachment, charger-0v.png).

No matter were I click or what I refresh, I see a brown+black cat under some LED lights, just that the picture is wrongly rotated with +90.


LATER EDIT:
------------------
- Using FF+Kubuntu+logged into EEVblog, I see the +90* rotated cat picture, either thumbnail, or enlarge inside forum, or only pic in another tab.

- Using LibreWolf (LibreWolf == Firefox with some stripped away tracing) and no EEVblog login, I see a schematic with 4 plots.  ???
Title: Re: Server Error Reports
Post by: Nominal Animal on March 19, 2023, 07:11:23 pm
No matter were I click or what I refresh, I see a brown+black cat under some LED lights, just that the picture is wrongly rotated with +90.
Open the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) into a new tab, then press Shift while clicking the Refresh button.  This causes a force-reload.  Just clicking Refresh reloads the image from your local cache.
Title: Re: Server Error Reports
Post by: tautech on March 19, 2023, 07:26:02 pm
It's the prevalent SMF 1st attachment bug introduced with a forum upgrade a few years back. It bites in a couple ways and at this time the only work around is to NOT use the 1st attachment < I haven't for some years.  :horse:
Title: Re: Server Error Reports
Post by: RoGeorge on March 19, 2023, 07:59:42 pm
No matter were I click or what I refresh, I see a brown+black cat under some LED lights, just that the picture is wrongly rotated with +90.
Open the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) into a new tab, then press Shift while clicking the Refresh button.  This causes a force-reload.  Just clicking Refresh reloads the image from your local cache.

Might be something else, now it's the wrong picture to my FF, too, with or without refresh, with or without shift click.

An hour ago, Firefox+logged into EEVblog was showing the correct cat picture, while LibreWolf+not logged in was showing the wrong simulation picture.



the only work around is to NOT use the 1st attachment

I don't understand.  What exactly to not use?  What's a "1st attachment"?
Title: Re: Server Error Reports
Post by: tautech on March 19, 2023, 08:21:59 pm
No matter were I click or what I refresh, I see a brown+black cat under some LED lights, just that the picture is wrongly rotated with +90.
Open the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) into a new tab, then press Shift while clicking the Refresh button.  This causes a force-reload.  Just clicking Refresh reloads the image from your local cache.

Might be something else, now it's the wrong picture to my FF, too, with or without refresh, with or without shift click.

An hour ago, Firefox+logged into EEVblog was showing the correct cat picture, while LibreWolf+not logged in was showing the wrong simulation picture.



the only work around is to NOT use the 1st attachment

I don't understand.  What exactly to not use?  What's a "1st attachment"?
See attached screen capture.  ;)
Forget the dragg and drop option and only manually attach files of the permitted types and always skip the first (Choose File) attachment box.
Title: Re: Server Error Reports
Post by: Ed.Kloonk on March 20, 2023, 01:25:20 am
No matter were I click or what I refresh, I see a brown+black cat under some LED lights, just that the picture is wrongly rotated with +90.
Open the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) into a new tab, then press Shift while clicking the Refresh button.  This causes a force-reload.  Just clicking Refresh reloads the image from your local cache.

Might be something else, now it's the wrong picture to my FF, too, with or without refresh, with or without shift click.


Might be time to vacuum the cat fur out of the site server.
Title: Re: Server Error Reports
Post by: beanflying on March 20, 2023, 03:16:32 am
All of this is nothing to do with the server or SMF (proper) and everything to do with a few Image handling addons that got installed several years ago which broke some of the code when installed on top of each other.
Title: Re: Server Error Reports
Post by: Nominal Animal on March 20, 2023, 07:19:57 am
No matter were I click or what I refresh, I see a brown+black cat under some LED lights, just that the picture is wrongly rotated with +90.
Open the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) into a new tab, then press Shift while clicking the Refresh button.  This causes a force-reload.  Just clicking Refresh reloads the image from your local cache.
Might be something else, now it's the wrong picture to my FF, too, with or without refresh, with or without shift click.
Nope, the exact same thing.

When you load anything over http or https protocol, the server can specify an expiry time, telling the browser how long the resource should stay unchanged.  For the above file, the forum serves such an Expires header a year in the future, and also a Last-Modified header describing when the resource was last modified.

When you click Reload/Refresh, the browser only checks its own local cache; at most, it can send a HEAD request, which provides only the headers and none of the file data.

Thing is, the headers did not change.  They still reflect the original image file, claiming MIME type image/jpeg and file name IMG_20230316_110455672_HDR.jpg.  The actual data, however, is of image/png type, and not a JPEG file at all.

So, the browser just saw its cached data still valid, and re-showed the cached image.  When you do a force-reload, Shift+Reload, you tell the browser to skip the cache and header check, and do a GET request from the source (or proxy), which provided the new content.

Depending on your browser cache settings, when you closed that Firefox session (last open Firefox window), it discarded that cached image.  So, when you next opened Firefox and tried to look at the image, Firefox dutifully did a GET request because it didn't have it cached anymore, and bang, you see the replaced image.

You can trust me on this, because I can tell you exactly what is happening and how, even though I have never had access to an SMF implementation (source code).  It runs on Nginx, and the image/attachment provider part is written in PHP – the headers I receive with the above URL tell me that.  The image/attachment metadata in the database is not corrupted –– it still exists for both the old image and the new image, only the old image binary data was replaced with the new image binary data; you can verify that by looking at the headers of both the old (now switched) image, and the image that replaced it.  I am not sure whether the binary data is stored in the database or in binary files, so I cannot tell for sure whether it is the data itself or just the reference to the data that got changed for the old image, but I'd bet it is the reference; and the root bug is in the database query updating the binary data reference to the attachment after the upload completes.  Instead of updating just the one entry, it ends up sometimes updating the reference also for an older image.  Again, image metadata (format, file name) are not similarly confused, so this must be a separate update.

(I do have a decade of commercial development experience in this stuff; I did it for years before switching back to academia, but still have kept up with the (rather small) changes since then.)
Title: Re: Server Error Reports
Post by: gnif on April 20, 2023, 06:57:43 am
Please be aware that I am performing some general system maintenance and there may be minor interruptions during this.

Edit: Work has been completed.
Title: Re: Server Error Reports
Post by: gnif on April 20, 2023, 07:23:27 am
No matter were I click or what I refresh, I see a brown+black cat under some LED lights, just that the picture is wrongly rotated with +90.
Open the large image (https://www.eevblog.com/forum/chat/post-a-picture-of-a-cat!/?action=dlattach;attach=1741547;image) into a new tab, then press Shift while clicking the Refresh button.  This causes a force-reload.  Just clicking Refresh reloads the image from your local cache.
Might be something else, now it's the wrong picture to my FF, too, with or without refresh, with or without shift click.
Nope, the exact same thing.

When you load anything over http or https protocol, the server can specify an expiry time, telling the browser how long the resource should stay unchanged.  For the above file, the forum serves such an Expires header a year in the future, and also a Last-Modified header describing when the resource was last modified.

When you click Reload/Refresh, the browser only checks its own local cache; at most, it can send a HEAD request, which provides only the headers and none of the file data.

Thing is, the headers did not change.  They still reflect the original image file, claiming MIME type image/jpeg and file name IMG_20230316_110455672_HDR.jpg.  The actual data, however, is of image/png type, and not a JPEG file at all.

So, the browser just saw its cached data still valid, and re-showed the cached image.  When you do a force-reload, Shift+Reload, you tell the browser to skip the cache and header check, and do a GET request from the source (or proxy), which provided the new content.

Depending on your browser cache settings, when you closed that Firefox session (last open Firefox window), it discarded that cached image.  So, when you next opened Firefox and tried to look at the image, Firefox dutifully did a GET request because it didn't have it cached anymore, and bang, you see the replaced image.

You can trust me on this, because I can tell you exactly what is happening and how, even though I have never had access to an SMF implementation (source code).  It runs on Nginx, and the image/attachment provider part is written in PHP – the headers I receive with the above URL tell me that.  The image/attachment metadata in the database is not corrupted –– it still exists for both the old image and the new image, only the old image binary data was replaced with the new image binary data; you can verify that by looking at the headers of both the old (now switched) image, and the image that replaced it.  I am not sure whether the binary data is stored in the database or in binary files, so I cannot tell for sure whether it is the data itself or just the reference to the data that got changed for the old image, but I'd bet it is the reference; and the root bug is in the database query updating the binary data reference to the attachment after the upload completes.  Instead of updating just the one entry, it ends up sometimes updating the reference also for an older image.  Again, image metadata (format, file name) are not similarly confused, so this must be a separate update.

(I do have a decade of commercial development experience in this stuff; I did it for years before switching back to academia, but still have kept up with the (rather small) changes since then.)

This issue was thought to be fixed, I have just checked on disk and I can confirm that the file on disk contains the incorrect data. The file is indeed a PNG of a schematic, but the database thinks it is a JPEG.

The last time we had this issue it was identified to be a bug with the clustering filesystem (GlusterFS) which was causing inodes to be duplicated, upgrading the software resolved this and I do not see any duplicated inodes reported this time either.

If anyone figures out a reliable way to reproduce the fault and can provide step by step instructions so that I can dig deeper it would be greatly appreciated.
Edit: I have also contacted the OP of the message to try to obtain an exact copy of the image that it should be for further diagnostics

Edit2: It gets even stranger... I found the post the replaced image comes from, and it's even from the same user.
https://www.eevblog.com/forum/beginners/resistor-y-junction-calculations/msg4764878/#msg4764878 (https://www.eevblog.com/forum/beginners/resistor-y-junction-calculations/msg4764878/#msg4764878)

Edit3: Even stranger again... I pulled the two files from the server, they are the identical image, but they are different on disk. One has been altered/reprocessed? Starting to suspect a buggy image optimisation plugin or something.
Title: Re: Server Error Reports
Post by: magic on April 20, 2023, 09:30:26 pm
The situation with attachments is a big mess and it looks like a forum bug.

It appears that posting an image occasionally overwrites the exact previous image posted by the same user, regardless of file format, thread or any posts in between made without attachments. No reliable trigger is known and it is unclear if the same could happen to non-image attachments.

A recent thread about it
https://www.eevblog.com/forum/chat/im-beginning-to-see-some-new-file-attachment-wrong-file-errors-again/ (https://www.eevblog.com/forum/chat/im-beginning-to-see-some-new-file-attachment-wrong-file-errors-again/)

The inline images plugin got blamed last time and it has been half-disabled for over a year now. You can select the relevant option while posting, but the forum doesn't render resulting [attachimg] tags. I seems to recall that Dave did an SMF upgrade shortly before the issue returned this year.

Sorry for not bringing this thread to your and Dave's attention earlier, I assumed that somebody (like maybe the OP) had already done so :palm:


edit
I'm not familiar with SMF internals and these plugins, but if you ask me, I would say that the location to write the attachment on disk gets written somewhere into the database, associated with the current user. Subsequently, a stupid race condition causes the file writing job to use the previous post's filename before the cached value is updated. Or maybe it doesn't get updated at all for some other stupid reason.

At any rate, the file name and path associated with the attachment doesn't seem to change. The contents are replaced. A few times we have seen XXX.JPG files with PNG contents in them or vice versa.
Title: Re: Server Error Reports
Post by: gnif on April 20, 2023, 11:39:02 pm
Sorry for not bringing this thread to your and Dave's attention earlier, I assumed that somebody (like maybe the OP) had already done so :palm:

No, I was aware of it but I was under the impression it was resolved. It was far worse at one stage.

I'm not familiar with SMF internals and these plugins, but if you ask me, I would say that the location to write the attachment on disk gets written somewhere into the database, associated with the current user.

The database just stores meta data and SMF writes each file to the disk with a name it generates, which is the unique primary key of the table combined with a hash of it's filename, the current time, and a random number.

Code: [Select]
$hash = sha1(md5($filename . time()) . mt_rand());
$filename = $id . '_' . $hash;

Quote
Subsequently, a stupid race condition causes the file writing job to use the previous post's filename before the cached value is updated. Or maybe it doesn't get updated at all for some other stupid reason.

Yeah, I am still not sure as to the cause as this should be impossible. PHP isn't multi-threaded per request per request, and since the filename/hash used is guaranteed by the database and the filename generation method that SMF uses to be unique, it should never happen.

What is even stranger is the post times of this latest incident was about 1/2 an hour apart, which rules out a race also. And finally, the new file that is written to disk incorrectly, is different from the file that it should be if it were just overwritten, it has also been altered/processed (this confirms it's a PHP/code bug, not fs or database)

Also what is further strange, SMF generates thumbnails when you try to view the thumbnail on the fly, it doesn't do it at image upload time. For this to have worked, the file on disk's contents needed to be correct to begin with.

I am on break for a few days, but as I can I will try to debug this futher.
Title: Re: Server Error Reports
Post by: McBryce on April 21, 2023, 01:02:07 pm
I had a similar problem on another forum. I found that it depended on what software was used to create or convert the image. I think we finally decided that it was a problem with the EXIF data containing wrong data.

McBryce.
Title: Re: Server Error Reports
Post by: PlainName on April 23, 2023, 09:54:35 pm
You probably already know this, but just in case.... I am getting database errors:

Quote
Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

In Buy&Sell and General Technical Chat. Obviously, it cleared up to post this.
Title: Re: Server Error Reports
Post by: gnif on April 23, 2023, 10:10:47 pm
Thanks, I will have a look.
I do have an alert for this instance but as it was fleeting I am unsure as to the cause at this time.

Edit: There was an issue with the database load balancer that has now been resolved.
Title: Re: Server Error Reports
Post by: gnif on April 24, 2023, 10:59:08 pm
Seems we had an outage during the night, one of the database servers had crashed out in a strange way. Cause is still yet unknown but being investigated.
Title: Re: Server Error Reports
Post by: PlainName on April 24, 2023, 11:13:15 pm
I came across that as it was going wrong, if it might help figure it out. I was trying to post and got:

Quote
The following error or errors occurred while posting this message:
Your session timed out while posting. Please try to re-submit your message.

Happened in the crowd funding section, and then when I tried to post here (of course). A the time I could read messages, just not post.
Title: Re: Server Error Reports
Post by: gnif on April 24, 2023, 11:23:42 pm
Yeah, thanks, I saw this also

Edit: Please be aware that I am still investigating this, we are seeing the database service get into a unrecoverable deadlock state and the cause is still unknown.
Title: Re: Server Error Reports
Post by: gnif on April 25, 2023, 11:36:20 am
I have made some infrastructure changes that should not only resolve the crashing that has been occurring over the last few days, but also improve overall performance of the website quite considerably.
If you are noticing any improvement/degredation please provide feedback here:

https://www.eevblog.com/forum/chat/server-upgrade-feedback/ (https://www.eevblog.com/forum/chat/server-upgrade-feedback/)
Title: Re: Server Error Reports
Post by: tautech on April 25, 2023, 12:01:24 pm
This after selecting to view new replies is a PITA:
Please try again. If you come back to this error screen, report the error to an administrator.
Title: Re: Server Error Reports
Post by: gnif on April 25, 2023, 12:09:14 pm
Already reported in the other thread, investigating

Edit: This is fixed
Title: Re: Server Error Reports
Post by: m k on June 02, 2023, 09:34:50 am
I've recently had few hiccups.
First one was few minutes where page was finally loaded but content was database error.
Possibly just a database restart.

Now login and post were acting up, maybe timed out somehow but without updated Firefox window.
Like where post reply page is still present but new post is also live.
Maybe database machine has some issues.

I'm also quite sure I saw gnif's edit of a post about Steve Bannon and law where sub forum of deleted messages was mentioned.
Search can't find it anymore.
Title: Re: Server Error Reports
Post by: gnif on June 02, 2023, 09:41:09 am
I've recently had few hiccups.
First one was few minutes where page was finally loaded but content was database error.
Possibly just a database restart.

We do not do database restarts, it was likely a peak load period, we get them from time to time.

Now login and post were acting up, maybe timed out somehow but without updated Firefox window.
Like where post reply page is still present but new post is also live.
Maybe database machine has some issues.

This is just latency in the server responding to you after posting, the new data was clearly inserted into the database and some kind of latency caused you to hang on the post page while waiting. There are no DB issues.

I'm also quite sure I saw gnif's edit of a post about Steve Bannon and law where sub forum of deleted messages was mentioned.
Search can't find it anymore.

When someone replies to a topic we can't just delete it, it must be manually moved to a "Deleted" area of the forums. We do not actually delete posts fully so that we have a record of why people were banned, etc. SMF by default has set to post a redirect link when you move a thread, I accidentally left this enabled. This area of the forum is not available to the public.
Title: Re: Server Error Reports
Post by: RoGeorge on June 16, 2023, 03:14:26 pm
Can log and browse but can not post from Ro, when using usual browsers (e.g. firefox/ubuntu).  This post was made through a VPN.  The error is session timeout, please try to logoff/login again, but whatever I do it does not fix the err.

Any advice how to fix this, please?
Title: Re: Server Error Reports
Post by: gnif on June 16, 2023, 03:30:07 pm
Right in the middle of some minor changes, that might be the cause. Please hold.
Title: Re: Server Error Reports
Post by: gnif on June 16, 2023, 05:06:40 pm
Work completed for tonight, still a few loose ends to sort out, but in no worse state for it :)
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 01:46:43 pm
Just an update, one of the packages upgraded seems to be causing an issue with the database backup procedure which runs each night at 22:00 UTC. The database is being locked during the backup which should not occur, which is causing a brief outage while the backup happens.

I have implemented what I hope is a fix to this issue and running another backup to see if it's resolved.
Title: Re: Server Error Reports
Post by: RoGeorge on June 17, 2023, 02:33:47 pm
For me still not working.  Managed to post once from Ro, then timeout err again.  This one is from VPN.  I wonder if the cookies were tied to the IP, because I could post from Ro, then I couldn't edit it one minute later (with Modify button), then from there only session expired try to resubmit err.  Checking if it works from new IP only, and in the first minutes only.

Later edit
Worked from VPN (which implies new IP for me

Later later edit
Will stay here a little longer to test if I can only post in the very first minutes after a login from a new IP
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 02:36:39 pm
What IP are you coming from when it times out (PM me)
Title: Re: Server Error Reports
Post by: RoGeorge on June 17, 2023, 02:39:32 pm
Will check now and PM you in a minute, from this login
Title: Re: Server Error Reports
Post by: magic on June 17, 2023, 03:33:27 pm
I noticed that my /unread/ list gets cleared randomly since maybe yesterday. I think it first happened after some outage (database connection error, bad gateway), but now it happened again without any outage that I noticed.

The attachment substitution bug is still present, like here (https://www.eevblog.com/forum/projects/picoammeter-design/msg4912327/#msg4912327).
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 03:41:23 pm
I noticed that my /unread/ list gets cleared randomly since maybe yesterday. I think it first happened after some outage (database connection error, bad gateway), but now it happened again without any outage that I noticed.

This is not related to any server issues, perhaps a SMF bug, but there is nothing in the server deployment that can explain this.

The attachment substitution bug is still present, like here (https://www.eevblog.com/forum/projects/picoammeter-design/msg4912327/#msg4912327).

I am still tracing this, it's rare to catch it in action among all the noise of other posts going on so the cause is still under investigation.
Title: Re: Server Error Reports
Post by: RoGeorge on June 17, 2023, 03:47:55 pm
Trying now from Ro, with Brave browser.  Will try to attach a printscreen.

Quote
The following error or errors occurred while posting this message:
Your session timed out while posting. Please try to re-submit your message.

later edit
Strange that I can post now (once) from a new browser (Brave) I've never logged into eevblog before, but couldn't from LibreWolf or Firefox which I use usually, all same Ro IP.
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 03:51:18 pm
Thanks, this is not a HTTP timeout as I was looking for, but rather a session tracking issue. Let me have a dig through the SMF source and see if I can spot anything obvious that we might be doing to trigger this.
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 03:57:54 pm
I have made a change to the code to log additional information, can you please re-try the PM post. I need it to generate the error so I can see what is going on, feel free to spam me until it occurs again.
Title: Re: Server Error Reports
Post by: RoGeorge on June 17, 2023, 04:16:38 pm
I've just tried a post from LibreWolf, and didn't work.
Then alt+tab to this brand new Brave and it worked.  This was posted with Brave.

Since nobody else sees the same error, maybe it's something on my side.
Will try in the next days from other live OS's, more browsers and more addresses, and let you know the results.

Thank you for the help.  :-+
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 04:17:29 pm
Sorry but it needs to be a PM as this is the code I have patched
Title: Re: Server Error Reports
Post by: RoGeorge on June 17, 2023, 04:22:12 pm
I have made a change to the code to log additional information, can you please re-try the PM post. I need it to generate the error so I can see what is going on, feel free to spam me until it occurs again.

Sent you this
Quote
PM sent to regenerate the error, as you requested

 from LibreWolf (didn't work) same " The following error or errors occurred while posting this message:

    Your session timed out while posting. Please try to re-submit your message.

"
I hope you can see it in the logs.  For now this Brave login seems 100% reliable.
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 04:22:24 pm
I just saw the attempts, unfortunately there wasn't enough information logged and I need it again now I have added some additional logging.
Title: Re: Server Error Reports
Post by: gnif on June 17, 2023, 04:25:06 pm
Ok, it's actually not a server side issue :)

The reason for the failure is `session_verify_fail` which is because you're switching browsers, SMF checks your logged in session is using the same user agent as it was logged in with. The only way this can really happen is if your two browsers are sharing the same cache/store so they are using the same cookies with the session ID in them.

(https://www.eevblog.com/forum/chat/website-error-reports/?action=dlattach;attach=1808080;image)

Going to a VPN changes your IP, so your session is completely invalidated and restarted.
Title: Re: Server Error Reports
Post by: RoGeorge on June 17, 2023, 05:29:27 pm
That was strange.  Will logoff from all browsers and clean all cookies just to be sure.  The err didn't happen before yesterday.  Maybe one of these browsers updated themselves yesterday.  I always thought LibreWolf and Firefox were completely independent from each other.

Sorry for taking your time with this, and thank you for finding the cause.
Title: Re: Server Error Reports
Post by: gnif on June 18, 2023, 02:19:23 am
Just an update, one of the packages upgraded seems to be causing an issue with the database backup procedure which runs each night at 22:00 UTC. The database is being locked during the backup which should not occur, which is causing a brief outage while the backup happens.

I have implemented what I hope is a fix to this issue and running another backup to see if it's resolved.

The fix worked and this has been resolved.

I noticed that my /unread/ list gets cleared randomly since maybe yesterday. I think it first happened after some outage (database connection error, bad gateway), but now it happened again without any outage that I noticed.

Now I have had more time to think on this, this backup issue actually explains this also. We are using ProxySQL to load balance between the servers, but all writes still are directed to one server to avoid issues with SMF's inability to handle mysql errors for retry correctly when there is an ID clash due to a insert record race (SMF is simply not designed for clustered setup). The only writes that are not directed to a single server are those of temporary tables which is what the /unread/ feature uses. ProxySQL tracks which server your connection is on if your session makes a temporary table and pins you to it.

When I need to service a MySQL backend often it involves restarting the service, which then causes ProxySQL to redirect you to the working server. At this point the temporary table associated with your session is gone and thus, your unread list is cleared until SMF has decided enough time has elapsed to re-create the table. This timeout is to avoid overloading the back end as it's quite an intensive operation to generate this list.

Because the backup process was locking the backend for writes, ProxySQL was treating the server as offline and invalidating all sessions on it.
Title: Re: Server Error Reports
Post by: RoGeorge on June 18, 2023, 09:05:12 am
Just FIY, found what was causing the misbehave in my Firefox and LibreWolf browser.  It's a Firefox plugin called 'Dark Reader' (it was installed and enabled in both browsers).  The plugin is automatically changing colors and backgrounds, so it turns light webpages into "night-mode" dark colored webpages.

If I enable 'Dark Reader' for EEVblog.com, I get the error and can not post, if I disable Dark Reader (for EEVblog only) then click post, I can post just as usual.

Now, I don't know if 'Dark Reader' extension is compromised and trying to hijack my session IDs, or maybe it is something else.  What I've tested twice, including while sending this, is that I can not post while 'Dark Reader' is active but if I disable Dark Reader for EEvblog then click Post again, it will work.  There are no other open browser, and I've closed all pages already, logout, and delete all cookies then restart FF and login.

Are there any graphical elements sent from EEVblog, and linked to the user session ID, such that a color changing plugin as 'Dark Reader' might alter and thus compromise the session ID?
Title: Re: Server Error Reports
Post by: gnif on June 18, 2023, 09:14:41 am
Are there any graphical elements sent from EEVblog, and linked to the user session ID, such that a color changing plugin as 'Dark Reader' might alter and thus compromise the session ID?
No

The addon per-chance altering your browsers useragent?

Logs show the following user agents have been used today from your IP:

Code: [Select]
Mozilla/5.0 (Windows NT 10.0; rv:114.0) Gecko/20100101 Firefox/114.0
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/114.0
Title: Re: Server Error Reports
Post by: RoGeorge on June 18, 2023, 10:49:37 am
I don't know if Dark Reader (or something else) is messing with the reported user agent.  AFAIK I have nothing installed to masquerade the browser type or the OS.  Never tried to hide them.

I've posted today once from Brave 1.52 (Chromium 114.0.5735)/Kubuntu 22.04.2 LTS, and the rest from Firefox (114.0.1 snap from canonical)/same Kubuntu OS.

It certainly happens something weird on my side, because I didn't fire up a Windows OS in months.  ???
Thanks for the log feedback.  Will investigate what's wrong with my PC.
Title: Re: Server Error Reports
Post by: T3sl4co1l on June 22, 2023, 06:17:48 pm
Uh oh, image cache / sync discrepancies may have returned?
https://www.eevblog.com/forum/beginners/is-this-the-right-capacitor/ (https://www.eevblog.com/forum/beginners/is-this-the-right-capacitor/)
At least from my end at time of writing, I see one thumbnail (closeup of a board?) in the OP attachment, but the expanded image is identical to the attachment three posts below.

(I don't know offhand if this might just be a case of the OP editing their attachment, maybe a mod/admin can tell?)

Tim
Title: Re: Server Error Reports
Post by: gnif on June 22, 2023, 06:25:22 pm
https://www.eevblog.com/forum/chat/website-error-reports/msg4913677/#msg4913677 (https://www.eevblog.com/forum/chat/website-error-reports/msg4913677/#msg4913677)
Title: Re: Server Error Reports
Post by: drakejest on June 24, 2023, 08:22:16 pm
Hello I would like to add that i have also been unable to post,comment, login, and logout. It is just now that im trying again ( not tried posting again yet), with the same error as others did

Quote
The following error or errors occurred while posting this message:
Your session timed out while posting. Please try to re-submit your message.

I tried using chrome, and firefox and i was using dark reader on both (not tried disabling it). it happened sometime in the last 7 days

edit: It is still happening now, and i tried disabling dark reader this time and was able to post this comment. Have we already know whats happening because i would like to continue using dark reader, light mode just hurts my eyes.
Title: Re: Server Error Reports
Post by: gnif on June 24, 2023, 08:34:43 pm
As per the prior diagnostics performed, this is a client side issue. The server checks if your user agent changes during your login session (which should NEVER happen) as a security measure. Clear your cookies, make sure your browsers are not sharing the same cookie store, etc.
Title: Re: Server Error Reports
Post by: magic on June 25, 2023, 09:57:39 am
Just an update, one of the packages upgraded seems to be causing an issue with the database backup procedure which runs each night at 22:00 UTC. The database is being locked during the backup which should not occur, which is causing a brief outage while the backup happens.

I have implemented what I hope is a fix to this issue and running another backup to see if it's resolved.

The fix worked and this has been resolved.

I noticed that my /unread/ list gets cleared randomly since maybe yesterday. I think it first happened after some outage (database connection error, bad gateway), but now it happened again without any outage that I noticed.

Now I have had more time to think on this, this backup issue actually explains this also. We are using ProxySQL to load balance between the servers, but all writes still are directed to one server to avoid issues with SMF's inability to handle mysql errors for retry correctly when there is an ID clash due to a insert record race (SMF is simply not designed for clustered setup). The only writes that are not directed to a single server are those of temporary tables which is what the /unread/ feature uses. ProxySQL tracks which server your connection is on if your session makes a temporary table and pins you to it.

When I need to service a MySQL backend often it involves restarting the service, which then causes ProxySQL to redirect you to the working server. At this point the temporary table associated with your session is gone and thus, your unread list is cleared until SMF has decided enough time has elapsed to re-create the table. This timeout is to avoid overloading the back end as it's quite an intensive operation to generate this list.

Because the backup process was locking the backend for writes, ProxySQL was treating the server as offline and invalidating all sessions on it.

Hi gnif, I hoped this means that /unread/ behavior would return to normal, but it hasn't.
My list is still getting cleared occasionally, maybe once per day on average. It currently goes back to 6:28AM UTC today.

I am not the only one, apparently:
https://www.eevblog.com/forum/supporters-lounge/show-unread-posts-since-last-visit/ (https://www.eevblog.com/forum/supporters-lounge/show-unread-posts-since-last-visit/)


I understand that this architecture implies that database outages are likely to get my list cleared and this isn't going to change anytime soon, but it hasn't been a daily occurrence until last week.
Title: Re: Server Error Reports
Post by: RoGeorge on June 25, 2023, 10:17:11 am
edit: It is still happening now, and i tried disabling dark reader this time and was able to post this comment. Have we already know whats happening because i would like to continue using dark reader, light mode just hurts my eyes.

To have a dark themed EEVblog, I keep 'Dark Reader' on, and tell 'Dark Reader' to not interact with EEVblog.  To do that, open any forum page, click on the 'Dark Reader' icon, then click on the top box in the dark reader settings where it is written "www.eevblog.com".  The "v www.eevblog.com (http://www.eevblog.com)" textbox will change into "x www.eevblog.com (http://www.eevblog.com)", and the EEVblog will become light themed, while the rest of the internet will remain dark-themed.

To make EEVblog forum dark themed (without Dark Reader), either change your forum settings to use a dark-theme (this forum used to have at least one), or do like I did, add another extension to the Firefox, called "Stylus".

With "Stylus" you can entirely redesign the appearance of the forum upon wish, including color changes.  I am using this 'Stylus/Grease Monkey' script to change the EEVblog pages into dark-themed:
Code: [Select]
h1 {font-size: 1.30em !important}
h2 {font-size: 1.20em !important}
h3 {font-size: 1.10em !important}
h4 {font-size: 1.00em !important}
h5 {font-size: 0.90em !important}
h6 {font-size: 0.80em !important}

xx-large {font-size: 1.3em !important}
x-large  {font-size: 1.2em !important}
large    {font-size: 1.1em !important}
medium   {font-size: 1.0em !important}
small    {font-size: 0.9em !important}
x-small  {font-size: 0.8em !important}
xx-small {font-size: 0.7em !important}

html, body, p, table, th, tr, td, div, a, form, frame, input, script, ul, ol, dl {
   /*font-family: Verdana !important; */
   /*font-size: 9pt !important;*/
}
pre, tt, code {
   font-family: Hack !important;
   font-size: 8pt !important;
   background: grey;
   color: yellow;
   border-radius: 4px !important;
}
blockquote, q {
   /*font-style: italic !important; */
   /*font-size: 1.0em !important;*/
}


/* EEVblog Forum */
.frame, .roundframe, .plainbox, .dropmenu a, .hslice td, .titlebg td,
.tborder>.description, .main_content>.description, #recent>.description,
#header, #content_section, #footer_section, #main_container p {
   background: #222 !important;
   color: #fff !important;
}
#upper_section, .cat_bar, .catbg, .table_grid th {
   background: #357 !important;
   border-radius: 5px !important;
}
div.title_bar, h3.titlebg {
   background: #357 !important;
   color: #fff !important;
}
div.title_barIC, h4.titlebg {
   background: #555550 !important;
   color: #fff !important;
}
div.additional_row {
   background: none !important;
}



/*
my tests begin
*/

/* also working, from MarkF
[url]https://www.eevblog.com/forum/programming/css-to-remove-eevblog-sideways-scroll-for-inline-attached-pics/[/url]

.bbc_img, .resized, [id*="thumb_"] {
   max-width: 100% !important;
}

*/

/* auto-shrink the inline attachement pics, so large pics won't need left-righ scrolling */
/* when attribute "id" starts with "thumb_", as in e.g. id="thumb_976862-0", do not overflow the width */
[id^="thumb_"] {
   max-width: 100%;
}

/*
.thumb_976862-0 {
    width:100%
}
*/

/*
CSS selector
*/

/*
#thumb_976862-0 img {
    width:100%
}
*/

/*
CSS path

html body div#wrapper div#content_section div.frame div#main_content_section div#forumposts form#quickModForm div.windowbg div.post_wrapper div.postarea div.post div#msg_3032334.inner img#thumb_976862-0
*/

/*
[attribute^="thumb"] {
    width:100%
}
*/

/*
my tests end
*/



.inner, .signature, .custom_fields_above_signature {
   border-color: #aaa !important;
}
.upperframe, .upperframe span, .lowerframe, .lowerframe span {
   height: 1px !important;
   background: #aaa !important;
   border-left: 1px solid #aaa !important;
   border-right: 1px solid #aaa !important;
}
.table_grid td {
   border: 1px solid #222 !important;
}
.hslice td {
   border: 1px solid #444 !important;
}
.info, .post, .signature h5 {
   background: inherit !important;
   color: #fff !important;
}
.forumtitle a {
   font-size: 16pt !important;
   font-weight: normal !important;
   background: inherit !important;
   color: #fff !important;
   text-decoration: none !important;
}
.greeting {
   font-weight: normal !important;
}
.username h4 {
   font-size: 14pt !important;
   background: inherit !important;
   color: #fff !important;
}
.list_posts {
   border-color: #aaa !important;
}
.lastpost, .navPages, .keyinfo h5, .floatleft h5, .windowbg td,  .windowbg2 td, .windowbg h4,
.reset a, .nextlinks a, .innerframe a, .roundframe a, .navigate_section a, .pagelinks a, .smalltext a,
.windowbg a, .windowbg2 a, .stickybg a, .stickybg2 a, .lockedbg a, .lockedbg2 a {
   background: inherit !important;
   color: #fff !important;
   text-decoration: none !important;
}
.windowbg, .windowbg span.topslice, .windowbg span.botslice,
.windowbg span.topslice span, .windowbg span.botslice span {
   background: #444 !important;
   color: #fff !important;
}
.windowbg2, .windowbg2 span.topslice, .windowbg2 span.botslice,
.windowbg2 span.topslice span, .windowbg2 span.botslice span {
   background: #333 !important;
   color: #fff !important;
}
.stickybg, .stickybg2, .title_barIC {
   background: #4c4c4c !important;
   color: #fff !important;
}
.lockedbg, .lockedbg a, .lockedbg2, .lockedbg2 a,
.locked_sticky2, .locked_sticky, .locked_sticky a, .locked_sticky2 a {
   background: #534 !important;
   color: #ccc !important;
}
.stickybg a, .stickybg2 a, .lockedbg a, .lockedbg2 a {
   font-weight: normal !important;
}
.thanks {
   font-style: italic !important;
   font-size: x-small !important;
   color: #fde18e !important;
}
.vob_protected, .vob_protected a:link, .vob_protected a:visited {
   color: #bdb !important;
}
.bbc_standard_quote {
   background: #555 !important;
}
.bbc_alternate_quote {
   background: #444 !important;
}
.bbc_standard_quote, .bbc_alternate_quote {
   /*font-size: 10pt !important;*/
   line-height: 1.2em !important;
   padding: 0.5em 1.0em !important;
   border-radius: 5px !important;
   border-color: #aaa !important;
   color: #fff !important;
}
.bbc_link:link, .bbc_link:visited {
   border-bottom: none !important;
   background: inherit !important;
   color: #ace !important;
}
.bbc_code {
   /*font-family: Consolas !important; */
   /*font-size: 10pt !important;*/
   line-height: 1.2em !important;
   padding: 0.5em 1.0em !important;
   max-height: 24.0em !important;
   border: 1px solid #aaa !important;
   border-radius: 5px !important;
   background: inherit !important;
   color: #fff !important;
}
.codeheader, .quoteheader {
   font-weight: bold !important;
   font-style: italic !important;
   background: inherit !important;
   color: #fff !important;
}
.firstlevel span {
   border: 1px solid #222 !important;
   border-radius: 5px !important;
   padding: 0em 0.5em !important;
   background: #555 !important;
   color: #fff !important;
}
.firstlevel span:hover {
   background: #e70 !important;
   border-radius: 5px !important;
}
.dropmenu a:hover {
   color: #e70 !important;
}
#upper_section input, #quick_edit_body_container textarea,
.generic_list input, .floatright input, .righttext input,
.content textarea, .content button, .content input, .content select,
.titlebg textarea, .titlebg button, .titlebg input, .titlebg select,
.plainbox textarea, .plainbox button, .plainbox input, .plainbox select,
.roundframe textarea, .roundframe button, .roundframe input, .roundframe select,
.description textarea, .description button, .description input, .description select {
   border: 1px solid #777770 !important;
   border-radius: 5px !important;
   background: #555550 !important;
   color: #fff !important;
}
.buttonlist a span, .buttonlist a.active span {
   background: none !important;
   color: #fff !important;
}
.buttonlist a {
   background: #555 !important;
   border-radius: 5px !important;
}
.buttonlist a:hover {
   background: #e70 !important;
   border-radius: 5px !important;
}
.buttonlist a.active:hover {
   background: #e70 !important;
   border-radius: 5px !important;
}
.forumtitle a:hover, .bbc_link:hover, .navPages:hover,
.reset a:hover, .nextlinks a:hover, .innerframe a:hover, .roundframe a:hover,
.navigate_section a:hover, .pagelinks a:hover, .smalltext a:hover,
.windowbg a:hover, .windowbg2 a:hover, .stickybg a:hover, .stickybg2 a:hover,
.lockedbg a:hover, .lockedbg2 a:hover {
   color: #e70 !important;
}
.arp_left {
   width: 45% !important;
}
.post img, .attachments img, .smiley {background: #eee !important;}
The script is the one made by MarkF with minor changes:  https://www.eevblog.com/forum/chat/forum-dark-theme/ (https://www.eevblog.com/forum/chat/forum-dark-theme/)
I'm using that with Firefox, on a Linux desktop.  No idea if the same can be applied for phone/tablet browsers.


I've just tried to submit this post with 'Dark Reader' enabled and On for EEVblog, and got the "Your session timed out while posting" err, then forbid 'Dark Reader' to interact with EEVblog, then click Post (twice), and it worked.
Title: Re: Server Error Reports
Post by: Monkeh on July 11, 2023, 07:30:23 pm
Getting a session verification error when trying to unsubscribe from threads - have indeed tried turning it off and on again (and removed all cookies).

E: And now some random time later, it works again. :-//
Title: Re: Server Error Reports
Post by: Karel on July 14, 2023, 07:55:22 am
Here it never works. If I want to unsubscribe I must use the link in the email received when there's a new message in that thread.
I cleared the cache and cookies and put Firefox in "troubleshooting mode" (all addons disabled) and the problem persists.
I tried a fresh install of Chromium and have the same problem. And ofcourse, this only happens with this forum...

See also this thread: https://www.eevblog.com/forum/news/session-verification-failed/ (https://www.eevblog.com/forum/news/session-verification-failed/)

Oh, and logging of from the forum is now always a two-step cycle. After the first attempt I get an error screen.
The second attempt works.
Title: Re: Server Error Reports
Post by: 3apw on July 15, 2023, 07:58:55 am
Hello EEVblog,

I have an issue with a NOTIFY function and my account in the https://www.eevblog.com/forum/testgear/phase-noise-analyzer-and-phase-noise-measurement/ (https://www.eevblog.com/forum/testgear/phase-noise-analyzer-and-phase-noise-measurement/)

System said: "Session verification failed. Please try logging out and back in again, and then try again."
According this advice I did it few times but without luck.

Could you please help with it?

Thanks, Karen
Title: Re: Server Error Reports
Post by: tggzzz on July 15, 2023, 10:13:45 am
I've been intermittently seeing this sequence for a couple of weeks:

Overall: a minor irritation, but might be indicative of something more significant.

[1] Session verification failed. Please try logging out and back in again, and then try again
Title: Re: Server Error Reports
Post by: 3apw on July 15, 2023, 12:00:01 pm
Thank you for the advice.  Unfortunately no luck.
Title: Re: Server Error Reports
Post by: FireBird on July 15, 2023, 09:10:29 pm
For me it’s a bit more irritating:
I have the feeling that the number of incidents has decreased within the some days.
Title: Re: Server Error Reports
Post by: ledtester on July 17, 2023, 06:10:11 am
Here are some recent instances of thumbnails and pics not matching...

In this thread:

https://www.eevblog.com/forum/testgear/rigols-new-dho800-oscilloscope-unbox-teardown/ (https://www.eevblog.com/forum/testgear/rigols-new-dho800-oscilloscope-unbox-teardown/)

Reply #2 (https://www.eevblog.com/forum/testgear/rigols-new-dho800-oscilloscope-unbox-teardown/msg4965187/#msg4965187)
Reply #7 (https://www.eevblog.com/forum/testgear/rigols-new-dho800-oscilloscope-unbox-teardown/msg4965244/#msg4965244)
Reply #9 (https://www.eevblog.com/forum/testgear/rigols-new-dho800-oscilloscope-unbox-teardown/msg4965268/#msg4965268)
Title: Re: Server Error Reports
Post by: RoGeorge on July 17, 2023, 07:20:18 am
This one here, too
https://www.eevblog.com/forum/projects/diy-modbus-rtu-fan-controller-coils-vs-registers/msg4964131/#msg4964131 (https://www.eevblog.com/forum/projects/diy-modbus-rtu-fan-controller-coils-vs-registers/msg4964131/#msg4964131)
the first thumbnail shows a screen capture with many opened windows, and when clicked it's another picture, with the printscreen of a text terminal instead.
Title: Re: Server Error Reports
Post by: EEVblog on July 19, 2023, 12:09:44 pm
Here are some recent instances of thumbnails and pics not matching...

Sorry, I think that was me fiddling with a setting.
Try it again now.
Title: Re: Server Error Reports
Post by: 3apw on July 20, 2023, 05:05:03 pm
I have an issue with a NOTIFY function and my account in the https://www.eevblog.com/forum/testgear/phase-noise-analyzer-and-phase-noise-measurement/ (https://www.eevblog.com/forum/testgear/phase-noise-analyzer-and-phase-noise-measurement/)

System said: "Session verification failed. Please try logging out and back in again, and then try again."
According this advice I did it few times but without luck.

Solved: source of the issue - Google Chrome browser.
Title: Re: Server Error Reports
Post by: FireBird on July 20, 2023, 05:17:53 pm
Solved: source of the issue - Google Chrome browser.
I can reproduce it with FireFox.
Title: Re: Server Error Reports
Post by: Karel on July 20, 2023, 10:02:26 pm
See this error all the time here with both Firefox and Chromium.
Title: Re: Server Error Reports
Post by: gnif on August 11, 2023, 09:50:02 am
For an unknown reason the PHP process on the server had gone into a bad state throwing hundreds of general protection faults on all HTTP servers in the cluster. Reason for this is as of yet unknown, looks like a bug in the PHP process itself.
Title: Re: Server Error Reports
Post by: MK14 on August 11, 2023, 09:54:19 am
Presumably that is why I haven't been able to get on to this forum, for the last few hours, until now.

Because of errors, which typically looked like this:

Quote
Max connect timeout reached while reaching hostgroup 1 after 10000ms
Title: Re: Server Error Reports
Post by: gnif on August 11, 2023, 09:57:28 am
Looks like a database fault but it wasn't, the PHP process was in a bad state. I will be scheduling an upgrade tonight to try to resolve this. There should be no interruptions during this upgrade
Title: Re: Server Error Reports
Post by: EEVblog on August 11, 2023, 11:28:30 am
For an unknown reason the PHP process on the server had gone into a bad state throwing hundreds of general protection faults on all HTTP servers in the cluster. Reason for this is as of yet unknown, looks like a bug in the PHP process itself.

Almost certainly no coincidence it happened right after I tried to update Wordpress. Different databases though, and I dont recall Wordpress website problem taking down the forum before?
Title: Re: Server Error Reports
Post by: gnif on August 11, 2023, 11:43:21 am
For an unknown reason the PHP process on the server had gone into a bad state throwing hundreds of general protection faults on all HTTP servers in the cluster. Reason for this is as of yet unknown, looks like a bug in the PHP process itself.

Almost certainly no coincidence it happened right after I tried to update Wordpress. Different databases though, and I dont recall Wordpress website problem taking down the forum before?

It does seems to be a coincidence, the Wordpress website runs on a different version of PHP which was unaffected and is isolated from the forum. Anything more is just speculation, the processes would have needed to have been run under a debugger with debug symbols to catch the fault and obtain any useful debugging information (which would kill server performance while waiting for it to fault again, if ever it decides to)
Title: Re: Server Error Reports
Post by: kcbrown on August 11, 2023, 10:02:56 pm
It does seems to be a coincidence, the Wordpress website runs on a different version of PHP which was unaffected and is isolated from the forum. Anything more is just speculation, the processes would have needed to have been run under a debugger with debug symbols to catch the fault and obtain any useful debugging information (which would kill server performance while waiting for it to fault again, if ever it decides to)

It depends on the degree to which the optimizer switches affect the performance of the server, among other things (e.g., do you need to set a memory watchpoint?).  It's possible to have debug symbols compiled in while the optimizer switches remain the same, but whether you get anything useful as a consequence when the fault occurs just depends.  Note that there's a huge difference between being able to see stack traces and being able to step through the code in a sane manner, and optimization affects the latter a lot more than the former.  There are some optimizations that could potentially interfere with getting a proper stack trace (e.g., -fomit-frame-pointer) but in reading up on it a bit it seems that it may have limited to no impact on x86-64.  I would expect gdb these days to be able to reconstruct the call stack even if -fomit-frame-pointer was in use, based on what I've read about what it does.

That leaves only the performance impact to the running binary.  Attaching a debugger in and of itself will do nothing to the performance of the running process unless the operating system underneath is horribly coded.  A segfault is something the operating system will detect and an attached debugger will be notified of that as soon as it happens, at which point the debugger can be used to examine the stacks and other things.  The debugger will be idle up until that point, and the running process will proceed as normal up until that point.

The main issue I've seen with debugging segfaults like that is that they often involve smashed stacks, and if that's happening then tracking them down might prove difficult at best.  Just enabling the stack protection in the compiler (-fstack-protector or -fstack-protector-all) could easily have a significant performance impact (I've never experimented with it so I really can't say), and if I understand the mechanisms it uses correctly, it's hit-or-miss anyway (meaning, something can scribble on your stack frame in such a way that it doesn't tickle the canary value), and only tells you which function's stack frame was smashed, not which code performed the smash.

Bottom line: whether or not you get a performance hit will depend on what exactly you're trying to chase down.  The faults you mentioned might be against the heap, or might be against the stack, or might even be against the heap as a result of improper changes to the stack.  There's no way to know without venturing down the rabbit hole.
Title: Re: Server Error Reports
Post by: ledtester on August 12, 2023, 03:42:59 am

It does seems to be a coincidence, the Wordpress website runs on a different version of PHP which was unaffected and is isolated from the forum. ...

Out of curiosity, what is the nature of the isolation?
Title: Re: Server Error Reports
Post by: gnif on August 12, 2023, 09:23:33 am

It does seems to be a coincidence, the Wordpress website runs on a different version of PHP which was unaffected and is isolated from the forum. ...

Out of curiosity, what is the nature of the isolation?

Sorry but we do not divulge details related to the security of the server
Title: Re: Server Error Reports
Post by: gnif on August 14, 2023, 05:29:59 am
It does seems to be a coincidence, the Wordpress website runs on a different version of PHP which was unaffected and is isolated from the forum. Anything more is just speculation, the processes would have needed to have been run under a debugger with debug symbols to catch the fault and obtain any useful debugging information (which would kill server performance while waiting for it to fault again, if ever it decides to)

It depends on the degree to which the optimizer switches affect the performance of the server, among other things (e.g., do you need to set a memory watchpoint?).  It's possible to have debug symbols compiled in while the optimizer switches remain the same, but whether you get anything useful as a consequence when the fault occurs just depends.  Note that there's a huge difference between being able to see stack traces and being able to step through the code in a sane manner, and optimization affects the latter a lot more than the former.  There are some optimizations that could potentially interfere with getting a proper stack trace (e.g., -fomit-frame-pointer) but in reading up on it a bit it seems that it may have limited to no impact on x86-64.  I would expect gdb these days to be able to reconstruct the call stack even if -fomit-frame-pointer was in use, based on what I've read about what it does.

That leaves only the performance impact to the running binary.  Attaching a debugger in and of itself will do nothing to the performance of the running process unless the operating system underneath is horribly coded.  A segfault is something the operating system will detect and an attached debugger will be notified of that as soon as it happens, at which point the debugger can be used to examine the stacks and other things.  The debugger will be idle up until that point, and the running process will proceed as normal up until that point.

The main issue I've seen with debugging segfaults like that is that they often involve smashed stacks, and if that's happening then tracking them down might prove difficult at best.  Just enabling the stack protection in the compiler (-fstack-protector or -fstack-protector-all) could easily have a significant performance impact (I've never experimented with it so I really can't say), and if I understand the mechanisms it uses correctly, it's hit-or-miss anyway (meaning, something can scribble on your stack frame in such a way that it doesn't tickle the canary value), and only tells you which function's stack frame was smashed, not which code performed the smash.

Bottom line: whether or not you get a performance hit will depend on what exactly you're trying to chase down.  The faults you mentioned might be against the heap, or might be against the stack, or might even be against the heap as a result of improper changes to the stack.  There's no way to know without venturing down the rabbit hole.

Obviously having compiled symbols in the binary are an option however packages provided by upstream do not do this and as we are running production binaries when this fault occurred we have nothing to go on. As this was a random occurrence and seems to have no regularity to it at this point (it may never even happen again) there is little point building custom binaries with debug symbols enabled making it difficult to keep updated with the latest security releases upstream as they become available.

Also attaching gdb does have a performance hit always, if you write low latency multi-threaded applications you will know that sometimes a bug is harder to reproduce when running under gdb as it slows things down enough to "fix" problems such as race conditions.

The PHP-FPM model uses FastGGI, and forks a set of child PHP processes which have a limited number of requests to serve before they are each restarted, this is done to avoid problems caused by potential memory leaks and is a common FastCGI strategy. The overhead of gdb following forks is quite heavy.

Please note that I have extensive experience in software debugging and development where my primary development IDE is ViM & gdb. I appreciate the input but in this instance at this point the cost vs benefit currently makes this not worth the effort when a simple service upgrade may resolve an issue that may have already been fixed upstream.
Title: Re: Server Error Reports
Post by: gnif on September 13, 2023, 12:29:16 am
The server outage this morning is being investigated, there is no need to report this. Cause is as of yet unknown, the database service had stopped responding.
Title: Re: Server Error Reports
Post by: Brumby on September 17, 2023, 04:49:08 am
Sorry but we do not divulge details related to the security of the server

That is the first rule of security for me: Don't provide any information.

Why give anyone a head start for hacking?

(Sorry gnif, I didn't mean to trigger a notification)
Title: Re: Server Error Reports
Post by: Karel on September 17, 2023, 06:16:55 am
Security through obscurity... hmmm...
Title: Re: Server Error Reports
Post by: gnif on September 17, 2023, 10:29:09 am
Security through obscurity... hmmm...

You are misusing the term, the software in use is open source and available to the public as such, public scrutiny. How we have decided to make use of this software and build the EEVBlog infrastructure is kept private as this knowledge makes it easier to infiltrate the system if someone does get a foothold in some software/service. This is called "operational security" and is very different to "security through obscurity".
Title: Re: Server Error Reports
Post by: KE5FX on September 18, 2023, 06:20:24 am
The term you're looking for may be "Defense in depth."  A lot of people confuse that with "Security through obscurity," but they aren't the same.
Title: Re: Server Error Reports
Post by: beanflying on October 04, 2023, 12:44:39 pm
Getting some patchy issues with the Server in the last day or so not being available and just had a prolonged outage.
Title: Re: Server Error Reports
Post by: gnif on October 04, 2023, 01:25:17 pm
We are aware, debugging an issue with the main website is having an impact on services.
Title: Re: Server Error Reports
Post by: wilfred on October 04, 2023, 02:30:43 pm
Security through obscurity... hmmm...

You are misusing the term, the software in use is open source and available to the public as such, public scrutiny. How we have decided to make use of this software and build the EEVBlog infrastructure is kept private as this knowledge makes it easier to infiltrate the system if someone does get a foothold in some software/service. This is called "operational security" and is very different to "security through obscurity".

According to my dictionary the use of obscurity was spot on. Your desire to keep knowledge of the infrastructure private  and not well known is pretty much the dictionary's definition.

Title: Re: Server Error Reports
Post by: gnif on October 04, 2023, 03:12:44 pm
Security through obscurity... hmmm...

You are misusing the term, the software in use is open source and available to the public as such, public scrutiny. How we have decided to make use of this software and build the EEVBlog infrastructure is kept private as this knowledge makes it easier to infiltrate the system if someone does get a foothold in some software/service. This is called "operational security" and is very different to "security through obscurity".

According to my dictionary the use of obscurity was spot on. Your desire to keep knowledge of the infrastructure private  and not well known is pretty much the dictionary's definition.

Say whatever you like, we do not rely on the server being kept secure by omitting information as such this is not "security through obscurity". Limiting operational information to the general public is a no brainier as it gives administrators more time to combat attacks in progress that are trying to probe for such information to progress the attack. Sure the attacker may not be able to break in at all due to the security layers in place, but why risk it? Why hand out a map to the treasure even though the treasure box is padlocked?

Again, we are using open software with industry standard well known and reviewed security implementations. We are not relying on security though some custom logic that is closed and has not been peer reviewed. We are not "secure" because we rely on the fact that people don't know the specifics of how things are configured.

If we are to apply your definition of "security by obscurity" one could argue that the authentication credentials used to access the servers are kept secret and as such is "security by obscurity".
Title: Re: Server Error Reports
Post by: Nominal Animal on October 04, 2023, 04:06:48 pm
According to my dictionary the use of obscurity was spot on. Your desire to keep knowledge of the infrastructure private  and not well known is pretty much the dictionary's definition.
Bullshit.  By that definition, not keeping your password on a post-it note stuck to your monitor would be security-through-obscurity also.

In the industry, "security through obscurity" is used to describe the situation when knowing the technical and implementation details of the system is sufficient to break the security scheme.  "Operational security" is used to describe the situation when the technical details of the system are kept private to limit the attack surface: knowing them does not break the security scheme, but it may help an attacker trying to break the security scheme by providing useful targeting information.

For example, if one accepts incoming SSH connections on a nonstandard port, and keeps that port number private (only telling those who do use those SSH connections), one applies operational security, not security through obscurity.  Revealing the port does not compromise security per se, but it can help attackers.  As security measures go, it is a very weak one, but if combined with diverting incoming connections from addresses that have recently tried to connect to other ports (especially the standard SSH port) to a designated honey pot, it can be a powerful tool for early automated attack detection.  Essentially, it does not provide any added security per se, but it definitely can help in detecting intrusion attempts, and focusing human security monitoring to where it is most likely needed.  Also, it does nothing at all against directed attacks.

Gnif uses the simplest operational security approach there is, one that is literal millenia old: minimize the attack surface by only providing information to those who actually need it.

The reason this is done, is that it makes attacks and intrusion attempts harder and more costly.  Before anyone can attack, they need to know what they are attacking, where, and how.  Even if an attacker uncovers this information, the security is not yet compromised; they still need to do the attack itself.  If an attacker cannot uncover that information, they need to guess what kind of an attack might work, and usually try several ones to have any kind of chance at success, and failed attack attemps tend to be easy to detect.

What benefit would there be for gnif or Dave or other gnif's clients, if they revealed the system security scheme details publicly?  Here, absolutely nothing; it would just make it easier for attackers to design and plan intrusion attempts to these systems.
There are certain forums where specific details and their application and usefulness are discussed, but to reduce the possibility of attackers exploiting the information discussed, they tend to be closed/insular, invitation-only, with real-world identity verification.  Me, I prefer physical meetings and face-to-face discussions, because of body language.
Title: Re: Server Error Reports
Post by: bd139 on October 05, 2023, 08:20:33 pm
Sort of.

To be fair it doesn't necessarily increase the attack risk but that depends on who you are. Most of the attack IVs are drive by i.e. from network scans etc. No one is going to read something in this forum and go "yay lets tear eevblog a new asshole". No joking but in the scale of things no one really gives a fuck about EEVblog because the end game has no financial advantage. I mean you might have pissed off an adversary by banning them for being a prick when posting but that's about the only major risk vector. Realistically defending against automated network attacks is probably the only major worry, followed by casual idiots attacking problems with the forum software. Fundamentally the profile depends if you are an interesting target i.e. you have a lot of PII, financial data and/or information to leverage to generate money in some way. Not all endpoints are equal.

But at no point should you make anyone's life easier for them if they are an adversary and that means keeping schtum on configuration, location, versions, everything. A dumbass could work that out. Do you pin a sign on your door with "I have a nice TV and the window is over there?". Nope!
Title: Re: Server Error Reports
Post by: Nominal Animal on October 05, 2023, 09:09:01 pm
No one is going to read something in this forum and go "yay lets tear eevblog a new asshole".
No, but there are many people that would love to cause Dave and gnif grief.  The kind of people who might frequent the seedy side of the web, looking for nasty scripts and 0day exploits for free or for little money, to use against their many "enemies".

Not real security risks, but annoying assholes.  And like you said, no reason to give them any more targeting information.

Realistically defending against automated network attacks is probably the only major worry, followed by casual idiots attacking problems with the forum software.
Determining and deciding that is something gnif and Dave and gnif's other clients would have to discuss first.  Like I said, gnif's operational security approach is the oldest, simplest one, and it makes sense.  Any other choice or approach must be evaluated; and when you are a responsible sysadmin/provider, such evaluations take time and effort.

Note that I am not claiming you are wrong in your assessment.  I am only saying that gnif's current approach requires no assessment, which makes it the easy, obvious choice.  To choose a different option, someone has to make the assessment and take responsibility.  It's only worth it if there is something weighty in the balance, and I personally only see curiosity on the other side of the balance, and no gain for Dave or gnif really.

But at no point should you make anyone's life easier for them if they are an adversary and that means keeping schtum on configuration, location, versions, everything. A dumbass could work that out. Do you pin a sign on your door with "I have a nice TV and the window is over there?". Nope!
I'd change that slightly, replacing 'if they are an adversary' with 'if you are not absolutely sure they are your friend/partner and reliable'.

Then again, I myself am "paranoid" about giving even myself too much access.  (Because if my account or private keys are compromised, I want to minimize the risk of harm to others.  While I do jokingly call it "paranoia", it too is just sensible operational security.)
Title: Re: Server Error Reports
Post by: PlainName on October 06, 2023, 09:00:10 pm
Ahem! Gnif has previously said he doesn't want this thread being anything but server reports. The discussion of what constitutes security, etc, perhaps should go in the thread I started (to derail exactly that from here) over in:
https://www.eevblog.com/forum/security/kneejerks/ (https://www.eevblog.com/forum/security/kneejerks/)
Title: Re: Server Error Reports
Post by: gnif on October 11, 2023, 08:28:29 am
Please be aware that we are performing some changes that may disrupt this service for a short period. I will post here again when the work is complete.
Title: Re: Server Error Reports
Post by: tautech on October 11, 2023, 08:56:30 am
Please be aware that we are performing some changes that may disrupt this service for a short period. I will post here again when the work is complete.
LOL, no kidding.
Please try again. If you come back to this error screen, report the error to an administrator.
Title: Re: Server Error Reports
Post by: Dan123456 on October 11, 2023, 10:13:25 am
Please be aware that we are performing some changes that may disrupt this service for a short period. I will post here again when the work is complete.
LOL, no kidding.
Please try again. If you come back to this error screen, report the error to an administrator.

Lol same  :P

Then it went to a 502 error for half an hour or so  :P Wasn’t sure if it my was on my end or what  :P

All good EEVBlog forum team! Thanks for the post :) Fingers crossed for you all  :)
Title: Re: Server Error Reports
Post by: gnif on October 11, 2023, 10:51:32 am
Ok, sorry about the outages, we are making some changes to improve server security.
The forum should be fully working now with the exception of existing attachments while we wait for on disk permissions to change. If attachments are not yet loading please just wait for now before reporting a fault. I will post when this is completed.

Edit: Please note that there may be gateway timeouts while this is in progress as it's quite I/O intensive.
Title: Re: Server Error Reports
Post by: gnif on October 11, 2023, 01:19:01 pm
Work has been completed :)
Title: Re: Server Error Reports
Post by: langwadt on October 11, 2023, 01:21:09 pm
Work has been completed :)

all attachments I've tried returns a "404 - Attachment Not Found"
Title: Re: Server Error Reports
Post by: Kean on October 11, 2023, 01:21:22 pm
Still getting "404 - Attachment Not Found" when clicking links to download attachments.
Title: Re: Server Error Reports
Post by: gnif on October 11, 2023, 01:34:36 pm
Can you please give me an example?
Title: Re: Server Error Reports
Post by: Kean on October 11, 2023, 01:35:30 pm
Can you please give me an example?

https://www.eevblog.com/forum/eda/dc-motor-low-battery-led-problem/msg5093811/#msg5093811 (https://www.eevblog.com/forum/eda/dc-motor-low-battery-led-problem/msg5093811/#msg5093811)
Title: Re: Server Error Reports
Post by: gnif on October 11, 2023, 01:36:18 pm
Thanks, might be just a path issue here. Investigating

Edit: Yup, it's working fine now.
Title: Re: Server Error Reports
Post by: HwAoRrDk on October 11, 2023, 07:14:29 pm
Is the fact the forum's mobile theme isn't working at present related to the work done earlier today?

All the mobile theme's CSS and image files are returning with 404 and 502 errors at present, which greatly delays the page rendering, and leaves it unusably un-styled when it does.
Title: Re: Server Error Reports
Post by: AndyBeez on October 11, 2023, 08:07:09 pm
Is the fact the forum's mobile theme isn't working at present related to the work done earlier today?

All the mobile theme's CSS and image files are returning with 404 and 502 errors at present, which greatly delays the page rendering, and leaves it unusably un-styled when it does.

Concure  :(
Title: Re: Server Error Reports
Post by: gnif on October 12, 2023, 01:16:02 am
Thanks for the report, I will look into it
Title: Re: Server Error Reports
Post by: gnif on October 12, 2023, 01:36:29 am
This has been fixed, rendering on mobile works fine now also.
Title: Re: Server Error Reports
Post by: syau on November 14, 2023, 08:33:08 am
Received the following error last few days:

-
Sorry syau, you are banned from using this forum!
This ban is not set to expire.
-

However I am able to enter the forum by using the Safari secure browsing in my phone  :-//
Title: Re: Server Error Reports
Post by: gnif on November 14, 2023, 08:08:52 pm
This is not a server error, the IP you're coming from must be banned. Please PM me the IP and I will have a look.
Title: Re: Server Error Reports
Post by: syau on November 15, 2023, 01:19:32 am
This is not a server error, the IP you're coming from must be banned. Please PM me the IP and I will have a look.

Fixed by clearing the safari cache.
Title: Re: Server Error Reports
Post by: gnif on November 15, 2023, 01:40:49 am
This is not a server error, the IP you're coming from must be banned. Please PM me the IP and I will have a look.

Fixed by clearing the safari cache.

Doubtful, you will only get this message if you connected to the website from a banned IP, and as the website content is dynamically generated your local browser will not cache it. It's more likely your IP changed.

If it happens again please PM me your IP so we can investigate. Otherwise please note that this thread is special, do not reply here unless you actually have a server error.
Title: Re: Server Error Reports
Post by: gnif on December 31, 2023, 07:18:47 am
Just a heads up.
Performing server maintenance and some software upgrades which may impact services. Please be patient, I will announce when the work is complete.
Title: Re: Server Error Reports
Post by: ledtester on January 05, 2024, 06:45:09 am
I just noticed a few thumbnails which don't match their images:

1st image of this post:

https://www.eevblog.com/forum/beginners/fall-time-from-digital-pot-results-in-brief-negative-voltage-why/msg5260113/#msg5260113 (https://www.eevblog.com/forum/beginners/fall-time-from-digital-pot-results-in-brief-negative-voltage-why/msg5260113/#msg5260113)

and the attached image of this post:

https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg5226579/#msg5226579 (https://www.eevblog.com/forum/testgear/test-equipment-anonymous-(tea)-group-therapy-thread/msg5226579/#msg5226579)
Title: Re: Server Error Reports
Post by: ledtester on January 05, 2024, 06:58:05 am
I just noticed a few thumbnails which don't match their images:

1st image of this post:

https://www.eevblog.com/forum/beginners/fall-time-from-digital-pot-results-in-brief-negative-voltage-why/msg5260113/#msg5260113 (https://www.eevblog.com/forum/beginners/fall-time-from-digital-pot-results-in-brief-negative-voltage-why/msg5260113/#msg5260113)
...

It appears the large thumbnail for this post is being taken from this post which occurs later in the thread:

https://www.eevblog.com/forum/beginners/fall-time-from-digital-pot-results-in-brief-negative-voltage-why/msg5260221/#msg5260221 (https://www.eevblog.com/forum/beginners/fall-time-from-digital-pot-results-in-brief-negative-voltage-why/msg5260221/#msg5260221)
Title: Re: Server Error Reports
Post by: gnif on January 05, 2024, 09:51:15 am
This has been reported countless times, we do not have a solution at this time. The current work being performed will allow us to move to a different file system that should resolve this issue.
Title: Re: Server Error Reports
Post by: gnif on January 06, 2024, 10:06:10 am
There will be some major maintenance of servers over the next few days as we upgrade some hardware in the systems. While there should not be an outage there may be short disruptions to services while this work is performed.

Edit 2024-01-12 07:51:06 - Note that this is still ongoing work, I will update this when the work is complete
Edit 2024-02-12 08:44:33 - Still ongoing work, expect a prolonged outage again soon while we move data onto new storage medium.
Title: Re: Server Error Reports
Post by: gnif on January 12, 2024, 09:09:23 am
Bumping this thread so people see this.

We will be making some major changes soon that will likely keep the forum down for several hours. I have asked Dave to make an announcement and schedule a time for when this is to commence. The goals here are to address several things.

1) As the forum has grown so has the hosting requirements, we are reaching I/O saturation and have decided to upgrade to faster storage medium.
2) We are still seeing attachment issues which still seem to be the fault of some rare bug in GlusterFS. As a result we are moving away from this to DRBD + GFS2
3) Even if GlusterFS was not faulting with the attachments, it's starting to get very slow and causing random stalls when dealing with large directories.

The decision to move from GlusterFS to DRBD + GFS2 has been made after several months of evaluation, however as we do not have a testing environment, we wont know how well it will work until we pull the trigger. We do expect quite a performance improvement, however it will be hard to determine if that is due to the change in the software stack, or the hardware upgrade.
Title: Re: Server Error Reports
Post by: EEVblog on January 12, 2024, 11:25:17 am
Thanks Geoff.
Go time will be 11pm tinght AEST.
Feel free to touch grass for a few hours.
Thanks.
Title: Re: Server Error Reports
Post by: gnif on January 12, 2024, 01:33:43 pm
Forums are back up (obviously) however attachments are still being copied over, so expect broken attachments until they have all moved over.
Title: Re: Server Error Reports
Post by: EEVblog on January 12, 2024, 02:55:44 pm
Forums are back up (obviously) however attachments are still being copied over, so expect broken attachments until they have all moved over.

Thanks.
Forum seems crazy quick!
But it was always slick.
Title: Re: Server Error Reports
Post by: gnif on January 12, 2024, 10:39:53 pm
Yes, there is certainly a huge performance boost here, IO load on average has dropped from 90+% to around 5-10%. DRBD + GFS2 is so much faster I can actually now count how many attachment files are on disk (for the record, over 810,000 files in one directory (SMF :palm:), and because it's so much less disruptive now to manage this directory we can start to look at migrating this into a proper directory structure.

Note the work is still not complete though, there is still a few things to shuffle around and there may be some minor outages lasting a few minutes while the work is completed.
Title: Re: Server Error Reports
Post by: gnif on January 13, 2024, 12:28:34 am
The major work has been completed but the site will still have some slowness while I remove the old now deprecated gluster storage. Once this is completed we should be back to normal, but faster ;)

Edit: work has been completed, there should not be any more interruptions to services.
Title: Re: Server Error Reports
Post by: gnif on February 06, 2024, 04:36:59 am
Heading this off before people report it. There was an unexpected power interruption at the Data Centre that brought the servers down that are hosting this website. Things are fully back online, and we are seeking information from the DC as to what the reason for the outage was.
Title: Re: Server Error Reports
Post by: gnif on February 06, 2024, 09:53:50 am
Just a heads up.

In the next 30 minutes or so there will be some disruptions while issues from the outage today are rectified. I will as always, post here when this work is complete.

Edit: Still in progress. sorry for the long outage, we are still having issues with data consistency across the cluster. We had the failed drive replaced and the fault moved to another disk, so we have been carefully bringing things back into a consistent state before allowing the DC to mess around with things futher.
Title: Re: Server Error Reports
Post by: ifrythings on February 06, 2024, 05:11:18 pm
Just a heads up.

In the next 30 minutes or so there will be some disruptions while issues from the outage today are rectified. I will as always, post here when this work is complete.

Edit: Still in progress. sorry for the long outage, we are still having issues with data consistency across the cluster. We had the failed drive replaced and the fault moved to another disk, so we have been carefully bringing things back into a consistent state before allowing the DC to mess around with things futher.

Would this cause the 502 bad gateway error and random “file not found” error that will load after several refreshes?
Title: Re: Server Error Reports
Post by: gnif on February 06, 2024, 05:13:45 pm
Yes, one of the servers in the cluster was having issues with accessing content on the disk.
Title: Re: Server Error Reports
Post by: gnif on February 07, 2024, 02:49:26 am
Services have returned to normal.