# Robots.txt file from http://www.searchengineworld.com # # Bans Directories # User-agent: * Disallow: /dontspidermysite/ Disallow: /bills/ Disallow: /Search/ Disallow: /SampleSearch/ Disallow: /billtext/ Disallow: /Images/ Disallow: /Utils/ Disallow: /aahpnews/ Disallow: /LogonExpired.asp Disallow: /cgi-bin/ Disallow: /logon/ Disallow: /css/ Disallow: /legislatorinfo/ Disallow: /text/ Disallow: /ssbilltext/ Disallow: /text/ Disallow: /textarchive/ Disallow: /regstext/