Useful Tips And Tricks From Semalt On How To Exclude Crawler And Spam From Your Website

Also known as spamdexing, referrer bombing is the current trend in the digital marketing sectors that will downfall your WordPress website in less than a week. In the past few months, cases of a web crawler and ghost referrer spam affecting e-commerce websites have been reported, posing a great danger to sites at the early stage of development.

Recently, we have launched a photography website focusing on babies and children. As a new website, we concentrated on developing our website but forget to block crawlers from indexing the site. Unfortunately, ghost referrer spam and crawler spam saw an opportunity to exploit. We started receiving referrals originating from a porn site.

As a webmaster, you don't want to find yourself being cornered by malicious referrals. Crawler referrer spam works to send you malicious links and driving fake traffic to your newly developed website. In the long run, you will end up clicking the link with the intention of identifying where most of your traffic comes from. This is how spammers earn dollars. Here are tricks and tips by Jack Miller, the Semalt Senior Customer Success Manager, that will help you to exclude crawler and spam from your website.

What you need to know about referrer spam

Spammers approach to website owners and online marketers has been changing as time goes by. Currently, spammers are making automated requests to websites owners and leaving bogus URLs that redirect website owners to malicious websites. An attacker tricks online marketers to click automated links out of curiosity. After clicking the links, spammers end up earning real cash, termed as an advertising fee.

Crawler referrer spam works on spiking fake traffic on your website. The time taken by counterfeit visits leads to a high bounce rate and minimal session duration, a critical factor that leads to algorithms ranking your converting keyword as negligible. Spammers take advantage of ghost referral spam where automated codes hijack your Google analytics code and end up skewing your data.

Tricks on how to exclude crawler and spam from your analytics

Using GM Block Bots to block referrer spam

Are you a webmaster encountering crawler referrer spam on your analytics? No need to panic. GM Block Bots is one of the most excellent WordPress plugins that work to exclude crawlers and spam such as and from your Google Analytics. To remove referrer spam using a WordPress plugin, upload the latest GM Block Bot version on your website, and then activate it.

Using .htaccess file to block referrer spam

As a webmaster, you can easily prevent and exclude referrer spam using a .htaccess file. This configuration file works to block malicious URLs from referring to your WordPress website. Simply add a generated code to your .htaccess file to block crawler referrer from skewing with your campaign's records.

What you need to know about ghost referrer

As compared to crawler referrer spam, ghost referrer spam can be excluded by setting up filters to block spam URLs. Create and use a valid hostname to block illegitimate URLs from providing data to your account.

After blocking bots, referrer spam, and unwanted traffic from referring to your website expects a drastic fall in your website's traffic. However, your bounce rate will shoot and encounter high session duration periods. Be vigilant and active to exclude crawler and spam from skewing with your Google Analytics report.