[help]web crawl error: URL restricted by Robot.txt

Hi guys
i ve a problem and i dont understand what does it mean despite i followed this tutorial http://bloggertricks.com/2007/12/how-to ... oogle.html and about adding meta tag too.

please could someone help me!

Those are all labels in that last image you posted.

Google is funny about Blogger labels, I've found plenty of my labels in Google searches that I've done for my own blogs. I have well over 60 Blogger labels, for one of my blogs, half of those (30) are listed the same way as yours. You have (9) labels blocked, I have (30) labels blocked.

Like I said, I still have search results showing a bunch of labels (strange ).

Switcher

That's not strange.. Google don't crawl Blogger Labels. They only crawl Permalink pages and Archive pages.

Google will crawl the Label as text, they won't follow the URL.

Have a look at the screenshot below, I searched Google for a Label name (animal mydxf), for one of my blogs, & it returns a bunch of other Labels, & how many Blogger Post for each Label.

Labels:
angel(1)
animal(9)
barn(1)
bell(2)
bird(2)
butterfly(3)
car(1)
Celtic(2)
christmas(19)
cnc(1)
corner bracket(1)

If you look at the first screenshot that Attalib, posted it says "URLs restricted by robots txt", so that means that they won't follow that Labels URL, but from what I've found on my blog, Google will read the Label as text.

So If someone is searching for example "animal" it's possible my blog will show up in the search results, because I have a Label named "animal", that Google is reading as regular text. I realize their is a slim chance since that blog isn't ranked high, still it is possible.

Switcher

"""That's not strange.. Google don't crawl Blogger Labels. They only crawl Permalink pages and Archive pages.""" Wrong
Labels and a permalinks called http://yourblogname.blogspot.com/search/label.... are two diferent things

search/label/blablablabla.... its not a problem, google only index your address and the address of your post (permalink), but not the search/label..., as you see the robots.txt exclude all your search/label but that don't mean that the address of your post its not indexed.

To reduce that I just don't show labels on post

Remove the widget Labels

Check in your blog all your links that send you to http://yourblogname.blogspot.com/search/label...... and delete all, instead put the link of a post, that solve a bit the problem


See your blog as a user and not as a owner... the widget Labels its not a great thing to have, some times its jus a west of time to the users, some times they think by cliking in a label that they find interesting the label going to redirect them to the post that contains thas labels (some times you have more than one post whit the same label ) that dont hapen...

Sorry I don't write in English so good...