Author Topic: [FORUM BUG] Search doesn't work properly  (Read 8426 times)

0 Members and 1 Guest are viewing this topic.

Online EEVblog

  • Administrator
  • *****
  • Posts: 37663
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #25 on: August 31, 2017, 01:58:08 am »
I hope you didn't turn this off, we switched to sphinx for full text indexing. If its not working we need to fix it, not turn it off.

Yep, sorry, I switched back to Full Index.
Seems to work fine though?
Why did we switch to Sphinx? and how can we be sure it's not going to get disabled again and no one notice until the search gets bad enough?
 

Offline gnif

  • Administrator
  • *****
  • Posts: 1672
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #26 on: August 31, 2017, 02:54:02 am »
I hope you didn't turn this off, we switched to sphinx for full text indexing. If its not working we need to fix it, not turn it off.

Yep, sorry, I switched back to Full Index.
Seems to work fine though?
Why did we switch to Sphinx? and how can we be sure it's not going to get disabled again and no one notice until the search gets bad enough?

MySQL is too slow when several searches occur at once, we saw widespread issues when Bing was using the search to index the website, but also when I tested it with a few concurrent searches. MySQL is not designed for this level of search/index, here are the stats from Sphinx:

Code: [Select]
collected 1276001 docs, 865.5 MB
sorted 143.9 Mhits, 100.0% done
total 1276001 docs, 865542064 bytes

So there is 143.9 million search terms being indexed. Services like google, ebay, amazon, etc... all use a full text search index such as Sphinx for datasets like this.

To avoid cPanel messing with it again I have created a system account for sphinx and configured a crontab for it, cPanel will not touch this account as it knows nothing about it.

Some more info on Sphinx (from http://sphinxsearch.com/about/sphinx/):

Quote
  • Indexing performance. Sphinx indexes up to 10-15 MB of text per second per single CPU core, that is 60+ MB/sec per server (on a dedicated indexing machine).
  • Searching performance. Searching through 1,000,000-document, 1.2 GB text collection that we use for everyday development and testing runs at 500+ queries/sec on a 2-core desktop machine with 2 GB of RAM.
  • Scalability. Biggest known Sphinx cluster indexes 25+ billion documents, resulting in over 9TB of data. Busiest known one is Craigslist, serving 300+ million search queries/day.
« Last Edit: August 31, 2017, 02:57:48 am by gnif »
 

Online EEVblog

  • Administrator
  • *****
  • Posts: 37663
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #27 on: August 31, 2017, 03:16:52 am »
Thanks gnif
It's switched back to Sphinx and seems to work again.
 

Offline PA0PBZ

  • Super Contributor
  • ***
  • Posts: 5121
  • Country: nl
Re: [FORUM BUG] Search doesn't work properly
« Reply #28 on: August 31, 2017, 08:27:16 am »
PA0PBZ, thanks for checking   :clap:  and apologies are in order as unfortunately I pasted the wrong link    :palm:  and updated my previous comment

Here is the suspect one >  https://www.eevblog.com/forum/thermal-imaging/thermal-camera-related-videos-and-reviews/msg1220335/#msg1220335

For me it doesn't halt but depending on the browser used it takes about 15-30 seconds to embed all 36 YouTube links. Of course if you run out of memory or your connection is slow anything can happen.
Keyboard error: Press F1 to continue.
 
The following users thanked this post: Electro Detective

Offline gnif

  • Administrator
  • *****
  • Posts: 1672
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #29 on: August 31, 2017, 04:46:31 pm »
PA0PBZ, thanks for checking   :clap:  and apologies are in order as unfortunately I pasted the wrong link    :palm:  and updated my previous comment

Here is the suspect one >  https://www.eevblog.com/forum/thermal-imaging/thermal-camera-related-videos-and-reviews/msg1220335/#msg1220335

For me it doesn't halt but depending on the browser used it takes about 15-30 seconds to embed all 36 YouTube links. Of course if you run out of memory or your connection is slow anything can happen.

Confirmed, slow load of this page is not server related but embedded content related.
 
The following users thanked this post: Electro Detective

Offline Electro Detective

  • Super Contributor
  • ***
  • Posts: 2715
  • Country: au
Re: [FORUM BUG] Search doesn't work properly
« Reply #30 on: September 01, 2017, 09:53:36 am »
Thanks guys   :-+   that page nukes my browser back to the Ice Age  :o

 

Online EEVblog

  • Administrator
  • *****
  • Posts: 37663
  • Country: au
    • EEVblog
Re: [FORUM BUG] Search doesn't work properly
« Reply #31 on: September 01, 2017, 12:15:33 pm »
Thanks guys   :-+   that page nukes my browser back to the Ice Age  :o

Took about 10 seconds to load that on my Surface Pro Win 10 Chrome with 30 other tabs open (yes, I have a Tab sickness), but no problems.
 

Offline b_forceTopic starter

  • Super Contributor
  • ***
  • Posts: 1381
  • Country: 00
    • One World Concepts
Re: [FORUM BUG] Search doesn't work properly
« Reply #32 on: September 01, 2017, 01:10:52 pm »
This topic has a very unique "word" in the title;
https://www.eevblog.com/forum/projects/gps-external-antenna-for-v-kel-vk2828u7g5lf/

If I search for "VK2828U7G5LF" (topic subject only), the result is zero.

I just tried that and it now works!  :-+
Thanks!
 :-+ :-+ :-+

Would it also be possible to search on 'newest post/message first'?
Now you can only select newest topic first (which is not the same)

« Last Edit: September 01, 2017, 01:12:27 pm by b_force »
 


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf