# This script specifies the files and folders the website that shouldn't # be indexed by search engine spiders. #User-agent field specifies the robot, for example googlebot. In this case all robots User-agent: * #Disallow prevents the robot from indexing/downloading the specified folders Disallow: /app/ Disallow: /backup/ Disallow: /class/ Disallow: /controller/ Disallow: /extensions/ Disallow: /kernel/ Disallow: /library/ Disallow: /smarty/ Disallow: /store/ Disallow: /templates/ Disallow: /templates_c/ #Disallow prevents the robot from indexing any dynamic urls Disallow: /?