Author Topic: [FORUM BUG] Search doesn't work properly  (Read 3673 times)

0 Members and 1 Guest are viewing this topic.

Offline b_force

  • Super Contributor
  • ***
  • Posts: 1173
  • Country: 00
    • One World Concepts
[FORUM BUG] Search doesn't work properly
« on: August 28, 2017, 12:02:12 am »
I wanted to use the search to find some topics that has been flooded away by the huge pile of new messages.

This topic was started in August, about one or two weeks ago.
Unfortunately I couldn't find it with the search.
However, I noticed that after using other words, the search doesn't seem to get any posts that are made in Augusts.
Mostly because all I found were posts at the end of July.

To show a few random results;

This topic has a very unique "word" in the title;
http://www.eevblog.com/forum/projects/gps-external-antenna-for-v-kel-vk2828u7g5lf/

If I search for "VK2828U7G5LF" (topic subject only), the result is zero.

Ok, another one, topic started at August 16;
http://www.eevblog.com/forum/projects/old-server-psu-pinout-(-astec-aa21060-)-or-how-to-turn-it-on/
Searching for "AA21060' = no result

Next one on August 2nd
http://www.eevblog.com/forum/projects/problem-with-hmc253/
No result

http://www.eevblog.com/forum/projects/proximity-sensor-anyone-use-mtch101-or-mtch105/
Searching for MTCH101, finally results!!!!


So, something is going wrong here???  :-//

Also, you can only sort on 'newest topic first', but that's only about when the topic was started.
There is not a option, 'newest post first'.

It's rather frustrating because on this forum people are pooing out new topics like the way bunnies do their magic.
This means that some topics are waaay gone after a week (sometimes even days)
"If you can't explain it simply (or at all), you don't understand it well enough." A. Einstein

http://www.oneworldconcepts.com/ | http://www.soundprojects.com
 

Offline Fungus

  • Super Contributor
  • ***
  • Posts: 9281
  • Country: 00
Re: [FORUM BUG] Search doesn't work properly
« Reply #1 on: August 28, 2017, 01:22:39 am »
I wanted to use the search to find some topics that has been flooded away by the huge pile of new messages.

It doesn't work. It's never worked.

It's rather frustrating

Use google instead. It works perfectly.
 
The following users thanked this post: SeanB

Offline sasa

  • Regular Contributor
  • *
  • Banned!
  • Posts: 168
  • Country: 00
  • Hobbyist in electronic
Re: [FORUM BUG] Search doesn't work properly
« Reply #2 on: August 28, 2017, 01:24:07 am »
The most forum engines fails in searching local database.

Fortunately, Google frequently update active public sites/forums. Instead using forum engine, searching by Google gives  exact link:

VK2828U7G5LF site:www.eevblog.com

One of the most helpful options offered by Google.
The 30+ years professional desktop software designer and software engineer
 

Offline Fungus

  • Super Contributor
  • ***
  • Posts: 9281
  • Country: 00
Re: [FORUM BUG] Search doesn't work properly
« Reply #3 on: August 28, 2017, 01:27:59 am »
The most forum engines fails in searching local database.

Fortunately, Google frequently update active public sites/forums. Instead using forum engine, searching by Google gives  exact link:

VK2828U7G5LF site:www.eevblog.com

One of the most helpful options offered by Google.

Or simply: "eevblog VK2828U7G5LF"
 

Offline b_force

  • Super Contributor
  • ***
  • Posts: 1173
  • Country: 00
    • One World Concepts
Re: [FORUM BUG] Search doesn't work properly
« Reply #4 on: August 28, 2017, 01:39:33 am »
The most forum engines fails in searching local database.
I don't know, but most other phpBB forums I know, are doing pretty fine actually.
Never had issues, except this forum.
« Last Edit: August 28, 2017, 01:41:44 am by b_force »
"If you can't explain it simply (or at all), you don't understand it well enough." A. Einstein

http://www.oneworldconcepts.com/ | http://www.soundprojects.com
 

Online Monkeh

  • Super Contributor
  • ***
  • Posts: 5666
  • Country: gb
Re: [FORUM BUG] Search doesn't work properly
« Reply #5 on: August 28, 2017, 05:32:20 am »
The most forum engines fails in searching local database.
I don't know, but most other phpBB forums I know, are doing pretty fine actually.
Never had issues, except this forum.

Well, this isn't phpBB..
 

Offline Brumby

  • Supporter
  • ****
  • Posts: 8443
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #6 on: August 28, 2017, 12:47:39 pm »
Indeed it's not.

It's SMF ... something which is displayed at the bottom of the page - however, with Dave's choice of background, it's next to impossible to see, unless you select the text.
 

Offline b_force

  • Super Contributor
  • ***
  • Posts: 1173
  • Country: 00
    • One World Concepts
Re: [FORUM BUG] Search doesn't work properly
« Reply #7 on: August 28, 2017, 11:14:11 pm »
The most forum engines fails in searching local database.
I don't know, but most other phpBB forums I know, are doing pretty fine actually.
Never had issues, except this forum.

Well, this isn't phpBB..
So????:-// :-//
What is your point?

I was just replying to the comment that 'most forum engines fail in searching'.
Which isn't true in my experience.


In fact, this is the first one were it doesn't work.
(and no, not all these other forums work on phpBB)
"If you can't explain it simply (or at all), you don't understand it well enough." A. Einstein

http://www.oneworldconcepts.com/ | http://www.soundprojects.com
 

Online RoGeorge

  • Super Contributor
  • ***
  • Posts: 1237
  • Country: ro
Re: [FORUM BUG] Search doesn't work properly
« Reply #8 on: August 29, 2017, 01:12:04 am »
Use Google search instead, and specify to Google that you want to return only the results coming from eevblog.com. Example (type this in Google search):

Code: [Select]
VK2828U7G5LF site:eevblog.com

Online Monkeh

  • Super Contributor
  • ***
  • Posts: 5666
  • Country: gb
Re: [FORUM BUG] Search doesn't work properly
« Reply #9 on: August 29, 2017, 03:27:01 am »
The most forum engines fails in searching local database.
I don't know, but most other phpBB forums I know, are doing pretty fine actually.
Never had issues, except this forum.

Well, this isn't phpBB..
So????:-// :-//
What is your point?

Your sentence implies that this, like the 'other phpBB' forums, runs phpBB.
 

Offline b_force

  • Super Contributor
  • ***
  • Posts: 1173
  • Country: 00
    • One World Concepts
Re: [FORUM BUG] Search doesn't work properly
« Reply #10 on: August 29, 2017, 08:27:12 am »
The most forum engines fails in searching local database.
I don't know, but most other phpBB forums I know, are doing pretty fine actually.
Never had issues, except this forum.

Well, this isn't phpBB..
So????:-// :-//
What is your point?

Your sentence implies that this, like the 'other phpBB' forums, runs phpBB.
I really don't see that implication at all?
Maybe I should have used brackets.
Doesn't matter, also not very relevant to be very honest.

The message was, other forums can do it, so why is it such a struggle here?
"If you can't explain it simply (or at all), you don't understand it well enough." A. Einstein

http://www.oneworldconcepts.com/ | http://www.soundprojects.com
 

Offline edavid

  • Super Contributor
  • ***
  • Posts: 2664
  • Country: us
Re: [FORUM BUG] Search doesn't work properly
« Reply #11 on: August 29, 2017, 09:28:37 am »
The message was, other forums can do it, so why is it such a struggle here?

Because this forum uses SMF, and SMF search doesn't work very well.

You could read about it in the many previous threads on the subject, except you probably can't find them  :-//
 

Offline sasa

  • Regular Contributor
  • *
  • Banned!
  • Posts: 168
  • Country: 00
  • Hobbyist in electronic
Re: [FORUM BUG] Search doesn't work properly
« Reply #12 on: August 29, 2017, 03:39:02 pm »
I was just replying to the comment that 'most forum engines fail in searching'.
Which isn't true in my experience.

I had quite a problem in the past to search on any forum and what is wrote is based on my experience. Probably latest versions indeed use FTS feature of MySQL or whatever database engine is used. Without FTS feature, indeed, it is not easy or it is rather slow to accomplish search. However, with FTS feature, database become really huge...

Anyway, it is not at all important is it phpBB, SMF or anything else. It is easy fixable by Google search site feature.

I do not use forums at all, though, as any thread ends as this one searching needle in a haystack...
The 30+ years professional desktop software designer and software engineer
 

Offline Brumby

  • Supporter
  • ****
  • Posts: 8443
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #13 on: August 30, 2017, 12:17:19 am »
The most forum engines fails in searching local database.
I don't know, but most other phpBB forums I know, are doing pretty fine actually.
Never had issues, except this forum.

Well, this isn't phpBB..
So????:-// :-//
What is your point?

Your sentence implies that this, like the 'other phpBB' forums, runs phpBB.
I really don't see that implication at all?

Initially, I didn't either - but then I didn't know about "phpBB" being one of the players.  (I've never really paid much attention to the software different forums run - but I do recognise SMF.)

Once I had Googled "phpBB", I got the same impression as Monkeh.
 

Offline Brumby

  • Supporter
  • ****
  • Posts: 8443
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #14 on: August 30, 2017, 12:25:15 am »
But, yeah, I've not had a brilliant search experience with SMF software.
 

Offline amyk

  • Super Contributor
  • ***
  • Posts: 6051
Re: [FORUM BUG] Search doesn't work properly
« Reply #15 on: August 30, 2017, 12:34:07 pm »
Use Google search instead, and specify to Google that you want to return only the results coming from eevblog.com. Example (type this in Google search):

Code: [Select]
VK2828U7G5LF site:eevblog.com
Google search is broken too, unfortunately. It picked up that thread but as of this post, this query...
Code: [Select]
site:eevblog.com hawkins electrical guide...doesn't find this thread of mine that's been around for almost a year. Ironically, the forum search does find that one. |O
 

Offline Electro Detective

  • Super Contributor
  • ***
  • Posts: 1751
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #16 on: August 30, 2017, 08:38:22 pm »
Hi guys, hopefully not too Off Topique or ranty   :-*

every time I try to view this awesome IR thermal camera post by Fraser it bogs down my browser to a halt till I close the page

http://www.eevblog.com/forum/thermal-imaging/thermal-camera-related-videos-and-reviews/msg1220335/#msg1220335

Fraser's other related posts load fine but not this one, have tried a few times  |O  and given up


Please advise if the problem is the page or the browser, wasn't sure where to submit this query    :-// 

Thanks :)   

« Last Edit: August 31, 2017, 08:54:27 am by Electro Detective »
 

Online PA0PBZ

  • Super Contributor
  • ***
  • Posts: 3835
  • Country: nl
Re: [FORUM BUG] Search doesn't work properly
« Reply #17 on: August 30, 2017, 08:54:37 pm »
Please advise if the problem is the page or the browser, wasn't sure where to submit this query    :-// 

Loads fine for me in Chrome, Firefox, Edge and IE.
(after manually copying the complete link)
Keyboard error: Press F1 to continue.
 

Offline Electro Detective

  • Super Contributor
  • ***
  • Posts: 1751
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #18 on: August 31, 2017, 08:58:13 am »
Please advise if the problem is the page or the browser, wasn't sure where to submit this query    :-// 

Loads fine for me in Chrome, Firefox, Edge and IE.
(after manually copying the complete link)


PA0PBZ, thanks for checking   :clap:  and apologies are in order as unfortunately I pasted the wrong link    :palm:  and updated my previous comment

Here is the suspect one >  http://www.eevblog.com/forum/thermal-imaging/thermal-camera-related-videos-and-reviews/msg1220335/#msg1220335

« Last Edit: August 31, 2017, 09:01:37 am by Electro Detective »
 

Offline EEVblog

  • Administrator
  • *****
  • Posts: 27954
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #19 on: August 31, 2017, 10:17:18 am »
I looked at the forum search settings and this is strange:



I have no idea what SphinxQL is is or when that was set. Maybe that's the problem.
I have changed to "Fulltext index", see if that makes a difference.
I am also building a custom "full" index but it will take some time.
 
The following users thanked this post: edavid

Offline EEVblog

  • Administrator
  • *****
  • Posts: 27954
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #20 on: August 31, 2017, 10:21:52 am »
This topic has a very unique "word" in the title;
http://www.eevblog.com/forum/projects/gps-external-antenna-for-v-kel-vk2828u7g5lf/

If I search for "VK2828U7G5LF" (topic subject only), the result is zero.

I just tried that and it now works!  :-+
 

Offline EEVblog

  • Administrator
  • *****
  • Posts: 27954
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #21 on: August 31, 2017, 10:28:16 am »
And I just tried a search on new thread started yesterday by searching "Vocabulary for beginners" and it found it as the only match as expected.
So the current full index seems to be up to date and being added to.
I think the search problem could be solved....
 

Offline edavid

  • Super Contributor
  • ***
  • Posts: 2664
  • Country: us
Re: [FORUM BUG] Search doesn't work properly
« Reply #22 on: August 31, 2017, 10:33:33 am »
And I just tried a search on new thread started yesterday by searching "Vocabulary for beginners" and it found it as the only match as expected.
So the current full index seems to be up to date and being added to.
I think the search problem could be solved....

Thanks!  It is definitely working better.

Are there any options for the default order of search results?  Or any way to display a "sort by" box, or "search within results"?
 

Offline gnif

  • Administrator
  • *****
  • Posts: 1056
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #23 on: August 31, 2017, 11:47:16 am »
I looked at the forum search settings and this is strange:



I have no idea what SphinxQL is is or when that was set. Maybe that's the problem.
I have changed to "Fulltext index", see if that makes a difference.
I am also building a custom "full" index but it will take some time.

I hope you didn't turn this off, we switched to sphinx for full text indexing. If its not working we need to fix it, not turn it off.
HostFission - Full Server Monitoring and Management Solutions.
https://hostfission.com/
https://twitter.com/HostFission

I volunteer my time to manage this server, if you would like to support this work I have a patreon here:
https://www.patreon.com/gnif
 

Offline gnif

  • Administrator
  • *****
  • Posts: 1056
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #24 on: August 31, 2017, 11:55:04 am »
It seems that somehow the cronjob that updates the sphinx index has been disabled/removed, likely by cPanel

Edit: I have switched Sphinx back on and will investigate the issue. There is simply too much content to rely on MySQL to search the content which is why we moved to a full text search engine (Sphinx)
Edit2: Issue resolved, the index has been rebuilt and the search is now working as expected.
« Last Edit: August 31, 2017, 12:12:36 pm by gnif »
HostFission - Full Server Monitoring and Management Solutions.
https://hostfission.com/
https://twitter.com/HostFission

I volunteer my time to manage this server, if you would like to support this work I have a patreon here:
https://www.patreon.com/gnif
 

Offline EEVblog

  • Administrator
  • *****
  • Posts: 27954
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #25 on: August 31, 2017, 11:58:08 am »
I hope you didn't turn this off, we switched to sphinx for full text indexing. If its not working we need to fix it, not turn it off.

Yep, sorry, I switched back to Full Index.
Seems to work fine though?
Why did we switch to Sphinx? and how can we be sure it's not going to get disabled again and no one notice until the search gets bad enough?
 

Offline gnif

  • Administrator
  • *****
  • Posts: 1056
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #26 on: August 31, 2017, 12:54:02 pm »
I hope you didn't turn this off, we switched to sphinx for full text indexing. If its not working we need to fix it, not turn it off.

Yep, sorry, I switched back to Full Index.
Seems to work fine though?
Why did we switch to Sphinx? and how can we be sure it's not going to get disabled again and no one notice until the search gets bad enough?

MySQL is too slow when several searches occur at once, we saw widespread issues when Bing was using the search to index the website, but also when I tested it with a few concurrent searches. MySQL is not designed for this level of search/index, here are the stats from Sphinx:

Code: [Select]
collected 1276001 docs, 865.5 MB
sorted 143.9 Mhits, 100.0% done
total 1276001 docs, 865542064 bytes

So there is 143.9 million search terms being indexed. Services like google, ebay, amazon, etc... all use a full text search index such as Sphinx for datasets like this.

To avoid cPanel messing with it again I have created a system account for sphinx and configured a crontab for it, cPanel will not touch this account as it knows nothing about it.

Some more info on Sphinx (from http://sphinxsearch.com/about/sphinx/):

Quote
  • Indexing performance. Sphinx indexes up to 10-15 MB of text per second per single CPU core, that is 60+ MB/sec per server (on a dedicated indexing machine).
  • Searching performance. Searching through 1,000,000-document, 1.2 GB text collection that we use for everyday development and testing runs at 500+ queries/sec on a 2-core desktop machine with 2 GB of RAM.
  • Scalability. Biggest known Sphinx cluster indexes 25+ billion documents, resulting in over 9TB of data. Busiest known one is Craigslist, serving 300+ million search queries/day.
« Last Edit: August 31, 2017, 12:57:48 pm by gnif »
HostFission - Full Server Monitoring and Management Solutions.
https://hostfission.com/
https://twitter.com/HostFission

I volunteer my time to manage this server, if you would like to support this work I have a patreon here:
https://www.patreon.com/gnif
 

Offline EEVblog

  • Administrator
  • *****
  • Posts: 27954
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #27 on: August 31, 2017, 01:16:52 pm »
Thanks gnif
It's switched back to Sphinx and seems to work again.
 

Online PA0PBZ

  • Super Contributor
  • ***
  • Posts: 3835
  • Country: nl
Re: [FORUM BUG] Search doesn't work properly
« Reply #28 on: August 31, 2017, 06:27:16 pm »
PA0PBZ, thanks for checking   :clap:  and apologies are in order as unfortunately I pasted the wrong link    :palm:  and updated my previous comment

Here is the suspect one >  http://www.eevblog.com/forum/thermal-imaging/thermal-camera-related-videos-and-reviews/msg1220335/#msg1220335

For me it doesn't halt but depending on the browser used it takes about 15-30 seconds to embed all 36 YouTube links. Of course if you run out of memory or your connection is slow anything can happen.
Keyboard error: Press F1 to continue.
 
The following users thanked this post: Electro Detective

Offline gnif

  • Administrator
  • *****
  • Posts: 1056
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #29 on: September 01, 2017, 02:46:31 am »
PA0PBZ, thanks for checking   :clap:  and apologies are in order as unfortunately I pasted the wrong link    :palm:  and updated my previous comment

Here is the suspect one >  http://www.eevblog.com/forum/thermal-imaging/thermal-camera-related-videos-and-reviews/msg1220335/#msg1220335

For me it doesn't halt but depending on the browser used it takes about 15-30 seconds to embed all 36 YouTube links. Of course if you run out of memory or your connection is slow anything can happen.

Confirmed, slow load of this page is not server related but embedded content related.
HostFission - Full Server Monitoring and Management Solutions.
https://hostfission.com/
https://twitter.com/HostFission

I volunteer my time to manage this server, if you would like to support this work I have a patreon here:
https://www.patreon.com/gnif
 
The following users thanked this post: Electro Detective

Offline Electro Detective

  • Super Contributor
  • ***
  • Posts: 1751
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #30 on: September 01, 2017, 07:53:36 pm »
Thanks guys   :-+   that page nukes my browser back to the Ice Age  :o

 

Offline EEVblog

  • Administrator
  • *****
  • Posts: 27954
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #31 on: September 01, 2017, 10:15:33 pm »
Thanks guys   :-+   that page nukes my browser back to the Ice Age  :o

Took about 10 seconds to load that on my Surface Pro Win 10 Chrome with 30 other tabs open (yes, I have a Tab sickness), but no problems.
 

Offline b_force

  • Super Contributor
  • ***
  • Posts: 1173
  • Country: 00
    • One World Concepts
Re: [FORUM BUG] Search doesn't work properly
« Reply #32 on: September 01, 2017, 11:10:52 pm »
This topic has a very unique "word" in the title;
http://www.eevblog.com/forum/projects/gps-external-antenna-for-v-kel-vk2828u7g5lf/

If I search for "VK2828U7G5LF" (topic subject only), the result is zero.

I just tried that and it now works!  :-+
Thanks!
 :-+ :-+ :-+

Would it also be possible to search on 'newest post/message first'?
Now you can only select newest topic first (which is not the same)

« Last Edit: September 01, 2017, 11:12:27 pm by b_force »
"If you can't explain it simply (or at all), you don't understand it well enough." A. Einstein

http://www.oneworldconcepts.com/ | http://www.soundprojects.com
 


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf