#excludes certain directories from being indexed by search engines User-agent: * Disallow: /images/ Disallow: /logs/ Disallow: /Library/ Disallow: /flash/ Disallow: /database/ Disallow: /cgi-bin/ Disallow: /aspnet_client/ Disallow: /Holiday/ Disallow: /Popups/