Comments on: Dynamic Robots.txt with ASP.NET 2.0 http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/ A brave new Hello World Wed, 20 Oct 2010 12:32:39 +0000 hourly 1 http://wordpress.org/?v=3.0.1 By: Wikus http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/comment-page-1/#comment-271 Wikus Fri, 22 Jan 2010 09:29:58 +0000 http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/#comment-271 Great article FTW! Not only helped me understand the concept of adding robots.txt for dealing with a HTTPS/HTTPS site but also introduced me to the concepts of ASP.NET HTTP Pipeline, HTTP Handlers and IIS App extension mappings.. :D Thanks a ton bud! Cheers Great article FTW!
Not only helped me understand the concept of adding robots.txt for dealing with a HTTPS/HTTPS site but also introduced me to the concepts of ASP.NET HTTP Pipeline, HTTP Handlers and IIS App extension mappings.. :D

Thanks a ton bud!

Cheers

]]> By: Phillip http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/comment-page-1/#comment-269 Phillip Wed, 20 Jan 2010 00:21:44 +0000 http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/#comment-269 How would I tell the robots.txt file which portions of the site to restrict? Would I use the web.config to do this? A code example would be great. How would I tell the robots.txt file which portions of the site to restrict? Would I use the web.config to do this? A code example would be great.

]]> By: Dynamic robots.txt file with .asp (or coldfusion) | Honk Blog http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/comment-page-1/#comment-249 Dynamic robots.txt file with .asp (or coldfusion) | Honk Blog Sat, 06 Jun 2009 20:37:37 +0000 http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/#comment-249 [...] By default IIS will treat .txt files as non dynamic and will simply render the text in them if they are called.  We want to tell IIS to parse them in the same way they would parse .asp files.  Note there’s a handy example of how to parse robots.txt files with ASP.net here. [...] [...] By default IIS will treat .txt files as non dynamic and will simply render the text in them if they are called.  We want to tell IIS to parse them in the same way they would parse .asp files.  Note there’s a handy example of how to parse robots.txt files with ASP.net here. [...]

]]> By: IIS7 User http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/comment-page-1/#comment-241 IIS7 User Fri, 12 Dec 2008 00:32:09 +0000 http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/#comment-241 The instructions for IIS7 is to set "System.Web.UI.SimpleHandlerFactory" as the Handler, using the "Handler Mappings" feature module within the site you want to change, while in IIS7 Manager. IIS7 Manager > Sites > SiteToChange > Handler Mappings > Add Managed Handler... Request Path: "*.txt" Type: "System.Web.UI.SimpleHandlerFactory" Name: "SimpleHandlerFactory" The instructions for IIS7 is to set “System.Web.UI.SimpleHandlerFactory” as the Handler, using the “Handler Mappings” feature module within the site you want to change, while in IIS7 Manager.

IIS7 Manager > Sites > SiteToChange > Handler Mappings > Add Managed Handler…

Request Path: “*.txt”
Type: “System.Web.UI.SimpleHandlerFactory”
Name: “SimpleHandlerFactory”

]]> By: Paul http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/comment-page-1/#comment-23 Paul Mon, 19 May 2008 07:24:03 +0000 http://www.kleenecode.net/2007/11/17/dynamic-robotstxt-with-aspnet-20/#comment-23 Hi there, great article! Would it be possible to update the article with instructions on configuring same in IIS7? Great blog BTW, you should post more! Best Wishes, Paul Hi there, great article!

Would it be possible to update the article with instructions on configuring same in IIS7?

Great blog BTW, you should post more!

Best Wishes,

Paul

]]>