Thread: Help me to write robot.txt
View Single Post
  #13 (permalink)  
Old 10-11-2007, 02:40 AM
Thomas Schulz's Avatar
Thomas Schulz Thomas Schulz is offline
Junior Member
  
Join Date: Jul 2006
Posts: 22
Thomas Schulz is on a distinguished road
iTrader: (0)
Default
It is useful e.g. if you have a dynamic page generating lots of pages with duplicate content.
Reply With Quote