# Allow all robots to crawl my site! User-agent: * Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /App_Themes/ Disallow: /Bin/ Disallow: /Forum/ Disallow: /Scripts/ Disallow: /yui_* Disallow: /Blog/yui_*