Go Back   WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum
Register Blogs FAQ Social Groups CalendarHelp Desk

Reply
 
LinkBack Thread Tools
Old 11-29-2009, 08:21 AM   #1
Active Warrior
 
Join Date: Jul 2008
Location: Lagos.
Posts: 36
Thanks: 3
Thanked 2 Times in 1 Post
Social Networking View Member's Myspace Profile  View Member's Twitter Profile 
Default How can i stop search engines from crawling my affiliate links?

Please i need help on how to stop search engines from crawling affiliate links in the body of my articles?

Or is there no purnishment for adding affiliate links in the body of articles in your blog?

Your answers will be highly valued

chinweike is offline   Reply With Quote
Old 11-29-2009, 08:25 AM   #2
PutYourSoulInWhatYouDo
War Room Member
 
Marko Vel's Avatar
 
Join Date: Nov 2007
Location: In Europe
Posts: 845
Thanks: 63
Thanked 107 Times in 64 Posts
Social Networking View Member's Twitter Profile 
Contact Info
Send a message via MSN to Marko Vel Send a message via Yahoo to Marko Vel Send a message via Skype™ to Marko Vel
Default Re: How can i stop search engines from crawling my affiliate links?

Hello chinweike
Maybe this will help you

"There will be some occassions in which webmaster of a site needs to stop search engines to crawl their web site.

* Like they want to give access to only to members.
* Data that they don’t want to be indexed in search engine results.

You can use two methods to stop search engines to crawl your web site:

* robots.txt in your root folder. Create a file called robots.txt on your computer. Keep the following lines in it and save.

User-agent:* Disallow: /

Upload it to your web site root folder in ASCII mode. This will stop crawling of your site by the robots that follow robots.txt rules.

But there are some bad bots that don’t care about robots.txt. You need .htaccess as an alternative.

* .htaccess protection. 99% of host panels now allow you to create password protection folders by selecting the directory and enter a user name and password.

Login into your web panel (Your host provides this host panel to manage your site) and see for a link ‘Password protection’ or ‘directory protection’. You can use that link to password protect your web site folders.

Steps:
1. Login your host panel.
2. Click on ‘Password protect Directories’. (This can be little vary from host to host.)



3. Navigate to the folder by clicking folder icons. Click on the folder name which needs to be protected. In this case your root directory folder like ‘public_html’, ‘httpdocs’, ‘html’ etc.



4. Enter needed details and password protect the whole site.

1a – Check the box
1b – Enter ‘Protected Area’
1c- Save.
This creates .htaccess file in the folder.

2a – Enter user name and password
2b – Add user
This creates .htpasswd file above root folder in ‘.htpasswds’.

This is basic method to add password protect directories in cpanel."
Marko Vel is offline   Reply With Quote
Old 11-29-2009, 08:37 AM   #3
Active Warrior
 
Join Date: Jul 2008
Location: Lagos.
Posts: 36
Thanks: 3
Thanked 2 Times in 1 Post
Social Networking View Member's Myspace Profile  View Member's Twitter Profile 
Default Re: How can i stop search engines from crawling my affiliate links?

Quote:
Originally Posted by Marko.V View Post
Hello chinweike
Maybe this will help you

"There will be some occassions in which webmaster of a site needs to stop search engines to crawl their web site.

* Like they want to give access to only to members.
* Data that they don’t want to be indexed in search engine results.

You can use two methods to stop search engines to crawl your web site:

* robots.txt in your root folder. Create a file called robots.txt on your computer. Keep the following lines in it and save.

User-agent:* Disallow: /

Upload it to your web site root folder in ASCII mode. This will stop crawling of your site by the robots that follow robots.txt rules.

But there are some bad bots that don’t care about robots.txt. You need .htaccess as an alternative.

* .htaccess protection. 99% of host panels now allow you to create password protection folders by selecting the directory and enter a user name and password.

Login into your web panel (Your host provides this host panel to manage your site) and see for a link ‘Password protection’ or ‘directory protection’. You can use that link to password protect your web site folders.

Steps:
1. Login your host panel.
2. Click on ‘Password protect Directories’. (This can be little vary from host to host.)



3. Navigate to the folder by clicking folder icons. Click on the folder name which needs to be protected. In this case your root directory folder like ‘public_html’, ‘httpdocs’, ‘html’ etc.



4. Enter needed details and password protect the whole site.

1a – Check the box
1b – Enter ‘Protected Area’
1c- Save.
This creates .htaccess file in the folder.

2a – Enter user name and password
2b – Add user
This creates .htpasswd file above root folder in ‘.htpasswds’.

This is basic method to add password protect directories in cpanel."
what am using is a wordpress blog. Is there no other way of doing it. I want a code that i can put my affiliate code in-between. And thanks for the reply

chinweike is offline   Reply With Quote
Old 11-29-2009, 09:24 PM   #4
Active Warrior
 
Join Date: Jul 2008
Location: Lagos.
Posts: 36
Thanks: 3
Thanked 2 Times in 1 Post
Social Networking View Member's Myspace Profile  View Member's Twitter Profile 
Default Re: How can i stop search engines from crawling my affiliate links?

can someone please help? i don't want to be purnished by search engines

chinweike is offline   Reply With Quote
Old 11-29-2009, 10:07 PM   #5
Advanced Warrior
 
Jacob Martus's Avatar
 
Join Date: Nov 2009
Location: Central Florida
Posts: 845
Thanks: 154
Thanked 219 Times in 148 Posts
Social Networking View Member's Myspace Profile  View Member's FaceBook Profile 
Contact Info
Send a message via Skype™ to Jacob Martus
Default Re: How can i stop search engines from crawling my affiliate links?

Why would you be punished for putting affiliate links in your blog? I thought that was the idea of affiliate marketing.

Jacob Martus is offline   Reply With Quote
Old 11-29-2009, 10:07 PM   #6
Senior Warrior Member
War Room Member
 
timpears's Avatar
 
Join Date: Jul 2008
Location: Vancouver, WA, USA.
Posts: 3,500
Thanks: 327
Thanked 584 Times in 408 Posts
Default Re: How can i stop search engines from crawling my affiliate links?

Can't you mask your affiliate links by linking them to another page on your site that is a simple redirect? Then use the robots.text and or the .htaccess process to stop the bots from crawling that page.

I don't understand this too well, but have wondered this myself and done some reading on it and this seems like it should work as well as anything would.

Tim Pears

timpears is online now   Reply With Quote
Old 11-29-2009, 10:19 PM   #7
Active Warrior
 
Join Date: Jul 2009
Posts: 62
Thanks: 35
Thanked 7 Times in 6 Posts
Default Re: How can i stop search engines from crawling my affiliate links?

Quote:
Originally Posted by Marko.V View Post
Hello chinweike
Maybe this will help you

"There will be some occassions in which webmaster of a site needs to stop search engines to crawl their web site.

* Like they want to give access to only to members.
* Data that they don’t want to be indexed in search engine results.

You can use two methods to stop search engines to crawl your web site:

* robots.txt in your root folder. Create a file called robots.txt on your computer. Keep the following lines in it and save.

User-agent:* Disallow: /

Upload it to your web site root folder in ASCII mode. This will stop crawling of your site by the robots that follow robots.txt rules.

But there are some bad bots that don’t care about robots.txt. You need .htaccess as an alternative.

* .htaccess protection. 99% of host panels now allow you to create password protection folders by selecting the directory and enter a user name and password.

Login into your web panel (Your host provides this host panel to manage your site) and see for a link ‘Password protection’ or ‘directory protection’. You can use that link to password protect your web site folders.

Steps:
1. Login your host panel.
2. Click on ‘Password protect Directories’. (This can be little vary from host to host.)



3. Navigate to the folder by clicking folder icons. Click on the folder name which needs to be protected. In this case your root directory folder like ‘public_html’, ‘httpdocs’, ‘html’ etc.



4. Enter needed details and password protect the whole site.

1a – Check the box
1b – Enter ‘Protected Area’
1c- Save.
This creates .htaccess file in the folder.

2a – Enter user name and password
2b – Add user
This creates .htpasswd file above root folder in ‘.htpasswds’.

This is basic method to add password protect directories in cpanel."

thanks alot i will try this out...
sean-john is offline   Reply With Quote
Old 11-29-2009, 10:27 PM   #8
Long Time Warrior
War Room Member
 
Mike Adams's Avatar
 
Join Date: Dec 2008
Location: United States
Posts: 591
Blog Entries: 2
Thanks: 17
Thanked 106 Times in 54 Posts
Contact Info
Send a message via Skype™ to Mike Adams
Default Re: How can i stop search engines from crawling my affiliate links?

There is no penalty to linking outside your blog within the context but if you must... Simply link using java http://internetprofituniversity.com/...cannot-follow/

P.S. If you found my post useful, please click the "Thanks" button below...
Mike Adams is offline   Reply With Quote
Old 11-30-2009, 12:29 AM   #9
Active Warrior
 
Join Date: Jul 2008
Location: Lagos.
Posts: 36
Thanks: 3
Thanked 2 Times in 1 Post
Social Networking View Member's Myspace Profile  View Member's Twitter Profile 
Default Re: How can i stop search engines from crawling my affiliate links?

Quote:
Originally Posted by Jacob Martus View Post
Why would you be punished for putting affiliate links in your blog? I thought that was the idea of affiliate marketing.
that is what am not too sure about

chinweike is offline   Reply With Quote
Reply

  WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum

Tags
affiliate, crawling, engines, links, search, stop

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -6. The time now is 02:21 PM.