| Server IP : 77.37.83.166 / Your IP :
216.73.216.66 [
Web Server : LiteSpeed System : Linux nl-srv-web1124.main-hosting.eu 4.18.0-553.121.1.lve.el8.x86_64 #1 SMP Thu Apr 30 16:40:41 UTC 2026 x86_64 User : u964240598 ( 964240598) PHP Version : 8.4.19 Disable Function : system, exec, shell_exec, passthru, mysql_list_dbs, ini_alter, dl, symlink, link, chgrp, leak, popen, apache_child_terminate, virtual, mb_send_mail Domains : 2 Domains MySQL : OFF | cURL : ON | WGET : ON | Perl : OFF | Python : OFF | Sudo : OFF | Pkexec : OFF Directory : /lib64/python2.7/ |
Upload File : |
�
zfc @ s} d Z d d l Z d d l Z d g Z d d d � � YZ d d d � � YZ d d
d � � YZ d e j f d
� � YZ d S( s& robotparser.py
Copyright (C) 2000 Bastian Kleineidam
You can choose between two licenses when using this package:
1) GNU GPLv2
2) PSF license for Python 2.2
The robots.txt Exclusion Protocol is implemented as specified in
http://www.robotstxt.org/norobots-rfc.txt
i����Nt RobotFileParserc B sb e Z d Z d d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z
d
� Z RS( ss This class provides a set of methods to read, parse and answer
questions about a single robots.txt file.
t c C s>