robots.txt

[dada]

Pozdrav svima,

zanima me da li je moj robots.txt u redu ? Stvarno se u to ne razumijem a čitajuči sve mi je manje jasno ...

ovako izgleda :

# If the Joomla site is installed within a folder such as at
# e.g. www.example.com/joomla/ the robots.txt file MUST be
# moved to the site root at e.g. www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to the disallowed
# path, e.g. the Disallow rule for the /administrator/ folder
# MUST be changed to read Disallow: /joomla/administrator/
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/orig.html
#
# For syntax checking, see:
# http://www.sxw.org.uk/computing/robots/check.html

# robots.txt generated at http://www.mcanerin.com
User-agent: *
Disallow:
Disallow: /cgi-bin/
Sitemap: http://www.apartmani-stara-novalja.com/sitemap.html

User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /logs/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/



Da li je to ok ili nešto od toga ipak mora biti dopušteno - što še preporuća? Da li treba nešto dodati da sigurnost weba bude veća i indexacija bolja?

Molim neku dobru dušu koja se u to kuži da mi pomogne jer se već duže s tim mučim a stvarno je to viša matematika za mene.
hvala

[Dario]

Pa eto ja bi samo spomenuo da osobno forsiram semantičke nazive slike, dakle ne "IMG_15748.jpg" već smisleno ime "naziv-datoteke-opisuje-sliku.jpg" i nemam Dissalow na images folder...
Razlog je jednostavan - indexiranje slika od strane tražilica - dakle SEO friendly :)

Ostalo mi sve izgleda ok :)

[dada]

Pozz,

pa i ja imam nazive (ključne riječi u imenima slika)   zato mi je ta stavka malo bila sumljiva ali kako se baš ne kužim u to...ostavila sam tako.

Znači da slike dozvolim pogledati ? i to je ok robots.txt   za  jedu prosječnu web stranicu?


hvala

[Dario]

Jep, ako ti je cilja da se i slike indexiraju - to bi bilo to :)

[Kamraws]

Its entirely possible Im misremembering, but didnt we remove our robots.txt file?  I seem to remember someone saying that google could now find us in searches again?

At any rate, if this allows the google spiders to find information on the site, I think thats good.  It seems its disallowing any searching of profile information?  I would say thats also good.