2 years ago

Harnessing the Power of Robots.txt

Sometimes, we may want search-engines to not list certain elements of the site, or even ban other SE from the site altogether.

This really is where a simple, little 2 line text file called robots.txt is available in.

read more...