robots.txt - Disallow search link on a website with robots txt -
i want disallow search link on site in robots.txt.
after click search submit button, url like:
example.com/searching?k=something
how can write url address robots.txt file?
my robots.txt file looks this:
user-agent: * disallow: /admin_folder sitemap: https://www.domain-address.com/sitemap.xml host: www.domain-address.hu
function search_k() { if($.trim($('#country_id').val()) != "" ) { //document.location = http_host+'/kereses.php?k='+$('#country_id').val(); var keyword = encodeuricomponent($('#country_id').val()).replace(/%20/g, '+'); document.location = http_host+'/searching?k='+keyword; } return false; }
if want disallow compliant robots crawling urls on site starting /searching
, add exclusion robots.txt
file after other disallow
commands:
disallow: /searching
for more details on format, read more the de-facto standard crawlers adhere to.
Comments
Post a Comment