# This file is used to notify crawlers/spiders what files to avoid User-agent: * Disallow: /Admin/ Disallow: /App_Code/ Disallow: /Bin/ Disallow: /js/ Disallow: /usercontrols/