Author Topic: The EEVblog Forum has MOVED BACK!  (Read 14771 times)

0 Members and 1 Guest are viewing this topic.

Offline EEVblogTopic starter

  • Administrator
  • *****
  • Posts: 37880
  • Country: au
    • EEVblog
Re: The EEVblog Forum has MOVED BACK!
« Reply #25 on: January 16, 2011, 04:44:56 am »
Did you also do an update?
I can see who is in a topic before clicking on it!
Cool!
apex

Yeah, I added a few extra's to the forum.
I won't be updating to Ver 2 of SMF until it goes public.

Dave.
 

Offline Simon

  • Global Moderator
  • *****
  • Posts: 17838
  • Country: gb
  • Did that just blow up? No? might work after all !!
    • Simon's Electronics
Re: The EEVblog Forum has MOVED BACK!
« Reply #26 on: January 16, 2011, 10:35:13 am »
To be honest I think people over push this SEO business, because that is what it is all about: business, many users have commented finding the forum on google when searching for the rigol or other stuff. I've setup websites before and they have got hits fairly quickly, the secret I think is just do it, do it right and you will reap. I setup www.rotaract1070.org.uk  for my rotaract district and it very soon got a lot of hits, when I looked in the stats at the searches viewers had performed to find it I noticed that it was not far down the list from the well established UK national site  that had been going for years www.rotaract.org.uk, and I did nothing special except for make sure I have plenty of relevant content.

I think this SEO lark is for the wanker "webmasters" that want to get results onto crap in hours without having anything decent to share. of course if you have a major website and then move it you will loose a back log of search results that will remain whilst being broken links until your website is recrawled and climbs the popularity list again. then again when your some ecomerce website selling the same crap as the next man I guess fractional advantages make a difference
 

Offline GeoffS

  • Supporter
  • ****
  • Posts: 1272
  • Country: au
Re: The EEVblog Forum has MOVED BACK!
« Reply #27 on: January 16, 2011, 12:04:15 pm »
When I first started my website just to get familiar with Wordpress etc, the google robots jumped on it very quickly and a search of my name and 'workshop' found the site pretty near the top of the list.
I still have the same number of hits a week (fairly low) but with the same search, my site doesn't even register.

This isn't a problem for me as I'm not try to make money of it but if it was a commercial venture, I wonder what the hell was going on.
 

Offline Simon

  • Global Moderator
  • *****
  • Posts: 17838
  • Country: gb
  • Did that just blow up? No? might work after all !!
    • Simon's Electronics
Re: The EEVblog Forum has MOVED BACK!
« Reply #28 on: January 16, 2011, 12:12:31 pm »
well of course it depends on the size of your website and what you are doing. there probably are things you can do to help but really unless your trying to squeeze every ounce playing by the book tends to work quite well, word of mouth is a great way of spreading. Beleive it or not having a rushdenrotaract.org.uk (which now simply redirects to a section of the rotaract1070.org.uk) meant that someone goggling "dogging in rusdhen" (don't ask I have NO idea my website has nothing to do with that sort of thing) got us a hit, the only operative word being infact "rushden"
 

Offline RayJones

  • Frequent Contributor
  • **
  • Posts: 490
    • Personal Website
Re: The EEVblog Forum has MOVED BACK!
« Reply #29 on: January 16, 2011, 10:19:24 pm »
OH NO,

is it just me, or the forum has once again developed the speed wobbles?

As I type, it is taking an eternity to load pages.

It is 22:15 UTC 16/1/11 ATM.

 

Offline mitpatterson

  • Regular Contributor
  • *
  • Posts: 89
  • Country: us
Re: The EEVblog Forum has MOVED BACK!
« Reply #30 on: January 16, 2011, 10:24:19 pm »
OH NO,

is it just me, or the forum has once again developed the speed wobbles?

As I type, it is taking an eternity to load pages.

It is 22:15 UTC 16/1/11 ATM.


Not just you, i emailed Dave and he said its slow for him too, and also that he is seeing some sort of "CPU throtalling"
 

Offline EEVblogTopic starter

  • Administrator
  • *****
  • Posts: 37880
  • Country: au
    • EEVblog
Re: The EEVblog Forum has MOVED BACK!
« Reply #31 on: January 16, 2011, 11:30:29 pm »
Yes, the site is being throttled
Bandwidth is in the order of 15-20GB/day.



I can only presume that the DNS has finally filtered through the net and now the full load is on the Hostmonster server and it simply can't handle the amount of database requests.
Looks like I might need a dedicated server...

Dave.
 

Offline Zad

  • Super Contributor
  • ***
  • Posts: 1013
  • Country: gb
    • Digital Wizardry, Analogue Alchemy, Software Sorcery
Re: The EEVblog Forum has MOVED BACK!
« Reply #32 on: January 17, 2011, 12:52:29 am »
That seems an awful lot of database requests when you consider the number of users and forum items on the site to be honest. I have now idea how to do diagnostics on the SMF software, but I think more investigations need to be done.

Offline Chasm

  • Regular Contributor
  • *
  • Posts: 211
Re: The EEVblog Forum has MOVED BACK!
« Reply #33 on: January 17, 2011, 01:23:47 am »
Yes, the site is being throttled
Bandwidth is in the order of 15-20GB/day.

That seems "a bit" excessive.
What produces this amount of traffic, the video files?


I can only presume that the DNS has finally filtered through the net and now the full load is on the Hostmonster server and it simply can't handle the amount of database requests.
Looks like I might need a dedicated server...

Dave.

I think a bit more research is necessary.
Well, you can solve any problem by throwing enough hardware at it but that is often not the solution, only a temporary fix. ;)


The forum is still rather on the small to tiny side of things, even for shared hosting.
The blog is not that huge either. Not much content or comments compared to others with a wider scope of topics.

Have wordpress or smf a tool to show you how many search engine bots are on the site?
Could be a move related re-indexing of their content.

Hmmm..... it could also be a indexing of eevforum.com, but that is a 301 redirect. - Still, if you can check URLs / referrers that may be a shot in the dark.
 

Offline GeoffS

  • Supporter
  • ****
  • Posts: 1272
  • Country: au
Re: The EEVblog Forum has MOVED BACK!
« Reply #34 on: January 17, 2011, 04:21:07 am »

That seems "a bit" excessive.
What produces this amount of traffic, the video files?

It shouldn't be, the video is server from Youtube.

Have wordpress or smf a tool to show you how many search engine bots are on the site?
Could be a move related re-indexing of their content.

Judging by my own website, search bots don't put a big load on the server, certainly not enough to explain that amount of bandwidth.

 

Offline EEVblogTopic starter

  • Administrator
  • *****
  • Posts: 37880
  • Country: au
    • EEVblog
Re: The EEVblog Forum has MOVED BACK!
« Reply #35 on: January 17, 2011, 04:34:31 am »

That seems "a bit" excessive.
What produces this amount of traffic, the video files?

It shouldn't be, the video is server from Youtube.

The podcast 480x270 video files are however serviced locally on the server.
There a several thousand who view the podcast version, so if you do the math the bandwidth figures come out right.

That also does not include my other websites.

Dave.
 

Offline Chasm

  • Regular Contributor
  • *
  • Posts: 211
Re: The EEVblog Forum has MOVED BACK!
« Reply #36 on: January 17, 2011, 04:44:04 am »
Had some serious problems with the googlebot a while back, after a change they re-indexed the whole site. That pretty much toasted a dedicated server. It should be easy to check if such a thing is the case.

Ah, Dave posted while I was typing so lets just say rephrase this and just say:
If the video files are not the reason for the gigabytes of traffic there is another serious problem with the site.
 

Offline williefleete

  • Regular Contributor
  • *
  • Posts: 109
  • Country: nz
Re: The EEVblog Forum has MOVED BACK!
« Reply #37 on: January 17, 2011, 04:55:48 am »
test post
if the videos are hosted on another server it shouldnt affect the bandwidth on the server
modern search engines use the site content to index usually text so that'll be a few Kb or more
if this site is getting the bandwidth sucked out of it then there is either a tonne of users accessing  or someone is downloading the entire site several times over
 

Offline joelby

  • Frequent Contributor
  • **
  • Posts: 634
Re: The EEVblog Forum has MOVED BACK!
« Reply #38 on: January 17, 2011, 11:37:51 am »
The bandwidth isn't really the biggest concern. It would be easy to move the downloadable video files over to Amazon S3 or another CDN.

High CPU and database usage is almost certainly due to poor programming in the blog and forum software, and these could mostly be fixed by enabling content caching. The blog itself should essentially require zero database accesses once cached because there aren't thousands of comments (you can just update the cached copy when a new comment is posted) and there's no user login facility. I can't think of any reason not to enable very aggressive caching in Wordpress in the EEVblog's case.

I've never administered an SMF installation, but it looks like it has some basic caching facilities, but these require the use of a PHP accelerator which the host may or may not support (most of these are commercial software, so it's unlikely that you'll get it on a shared server). The options are to rewrite bits of the forum to be less horrible (not trivial, but it might be a fun exercise) or move to a high-end virtual private server (not a $10/month one) or a dedicated server, or switch to a better piece of software.

In Australia, two of the largest forum sites are Whirlpool, which uses completely custom software, and OCAU, which uses vBulletin, which is commercial software but not especially expensive. Most of the huge international forums seem to be using custom software.
 

Offline Chasm

  • Regular Contributor
  • *
  • Posts: 211
Re: The EEVblog Forum has MOVED BACK!
« Reply #39 on: January 17, 2011, 08:24:10 pm »
At the moment the video files are on the same machine.
Serving large files is not that CPU intensive, but they can cause indirect problems if the provider throttles the bandwidth of the account/server after some amount of traffic. (After all there is no such thing as unlimited bandwidth/traffic unless you pay real money for it.)

For me a first step would be to turn of directory listing for the /video directory so that site crawlers don't see it. There are not only well behaved crawlers around.
If bandwidth throttling is indeed a problem another step would be to move the videos to another server/account.
I would go the sub-domain route, that way you can keep everything under the same domain name and still spread content over multiple servers.


As joelby mentioned the blog could be heavily cached without too much impact, for the most part it is static.


The forum is a bit more of a problem since it's contents are per definition dynamic. But then there does not seem to be that much traffic here. Hmmm, looking at the forum stats: 400k page views a month, 12k-15k page views a day, 4147 members, 2101 topics, 29493 posts.

There seem to be a lot of guests online at the moment, are they bots or humans?
There is also quite a lot of info open to the public. User profiles, user stats and so on and so forth. Restricting this to logged in users should reduce the server load further.
 

Online Mechatrommer

  • Super Contributor
  • ***
  • Posts: 11700
  • Country: my
  • reassessing directives...
Re: The EEVblog Forum has MOVED BACK!
« Reply #40 on: January 18, 2011, 03:35:31 am »
That also does not include my other websites.
Dave.
whats the other websites?
Nature: Evolution and the Illusion of Randomness (Stephen L. Talbott): Its now indisputable that... organisms “expertise” contextualizes its genome, and its nonsense to say that these powers are under the control of the genome being contextualized - Barbara McClintock
 

Offline DJPhil

  • Frequent Contributor
  • **
  • Posts: 511
  • Country: 00
Re: The EEVblog Forum has MOVED BACK!
« Reply #41 on: January 18, 2011, 04:45:15 am »
That also does not include my other websites.
Dave.
whats the other websites?

I'm guessing Dave means alternatezone and friends.
 

Offline Zad

  • Super Contributor
  • ***
  • Posts: 1013
  • Country: gb
    • Digital Wizardry, Analogue Alchemy, Software Sorcery
Re: The EEVblog Forum has MOVED BACK!
« Reply #42 on: January 19, 2011, 02:28:42 am »
I was checking Alexa.com for a friend's web site stats, and decided to have a look at EEVBlog's. Now, I know they are a bit of a blunt instrument, but check this http://www.alexa.com/siteinfo/eevblog.com specifically Pageviews/user.

In 2010 it was hovering around 4 or 5, then all of a sudden this month it has shot up to 15. I don't believe that more people are looking at 3 times the number of pages that they were before. I'm wondering if an indexing spider has gone feral or something and is hitting the database every few minutes and indexing the entire thing, skewing the stats. It does look a bit DDOSy.


Offline joelby

  • Frequent Contributor
  • **
  • Posts: 634
Re: The EEVblog Forum has MOVED BACK!
« Reply #43 on: January 19, 2011, 02:41:27 am »
In 2010 it was hovering around 4 or 5, then all of a sudden this month it has shot up to 15. I don't believe that more people are looking at 3 times the number of pages that they were before. I'm wondering if an indexing spider has gone feral or something and is hitting the database every few minutes and indexing the entire thing, skewing the stats. It does look a bit DDOSy.

Anything's possible (it would be quite obvious from AWStats et. al.), but if it really is Google's bot that is causing an overload, you can set a crawl rate using Google Webmaster Tools. Other search engines have different methods (e.g. Yahoo!)
 

Offline Chasm

  • Regular Contributor
  • *
  • Posts: 211
Re: The EEVblog Forum has MOVED BACK!
« Reply #44 on: January 19, 2011, 03:29:11 am »
In 2010 it was hovering around 4 or 5, then all of a sudden this month it has shot up to 15. I don't believe that more people are looking at 3 times the number of pages that they were before. I'm wondering if an indexing spider has gone feral or something and is hitting the database every few minutes and indexing the entire thing, skewing the stats. It does look a bit DDOSy.

The thing to remember about Alexa is that they track sites via their toolbar. That may not work to well with this audience since we know that most toolbars s*ck. Or at least I hope so. =)

Other than that, the answer is hidden in both the host based and integrated statistic tools.
 

Online Mechatrommer

  • Super Contributor
  • ***
  • Posts: 11700
  • Country: my
  • reassessing directives...
Re: The EEVblog Forum has MOVED BACK!
« Reply #45 on: January 19, 2011, 07:26:22 am »
I'm guessing Dave means alternatezone and friends.
thanx. thats a cool "original" website.
Nature: Evolution and the Illusion of Randomness (Stephen L. Talbott): Its now indisputable that... organisms “expertise” contextualizes its genome, and its nonsense to say that these powers are under the control of the genome being contextualized - Barbara McClintock
 


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf