HTML::RobotsMETA::Rules - A Representation Of Robots Exclusion Rules
$rules = $p->parse_rules($html); $bool = $rules->can_index(); $bool = $rules->can_follow(); $bool = $rules->can_archive(); $bool = $rules->can_serve(); $bool = $rules->can_imageindex(); $bool = $rules->can_imageclick();
HTML::RobotsMETA::Rules represents the robots exclusion policies that are described within HTML META tags.
To install HTML::RobotsMETA, copy and paste the appropriate command in to your terminal.
cpanm
cpanm HTML::RobotsMETA
CPAN shell
perl -MCPAN -e shell install HTML::RobotsMETA
For more information on module installation, please visit the detailed CPAN module installation guide.