Skip site navigation (1)Skip section navigation (2)

FreeBSD Manual Pages

  
 
  

home | help
Scrappy::Scraper::ContUser3Contributed Perl DocumeScrappy::Scraper::Control(3)

NAME
       Scrappy::Scraper::Control - Scrappy HTTP	Request	Constraints System

VERSION
       version 0.94112090

SYNOPSIS
	   #!/usr/bin/perl
	   use Scrappy::Scraper::Control;

	   my  $control	= Scrappy::Scraper::Control->new;

	       $control->allow('http://search.cpan.org');
	       $control->allow('http://search.cpan.org', if => {
		       content_type => ['text/html', 'application/x-tar']
		   }
	       );

	       $control->restrict('http://www.cpan.org');

	       if ($control->is_allowed('http://search.cpan.org/')) {
		   ...
	       }

	       # constraints will only be checked if the is_allowed method is
	       # passed	a HTTP::Response object.

DESCRIPTION
       Scrappy::Scraper::Control provides HTTP request access control for the
       Scrappy framework.

   ATTRIBUTES
       The following is	a list of object attributes available with every
       Scrappy::Scraper::Control instance.

       allowed

       The allowed attribute holds a hasherf of	allowed	domain/contraints.

	   my  $control	= Scrappy::Scraper::Control->new;
	       $control->allowed;

	       e.g.

	       {
		   'www.foobar.com' => {
		       methods => [qw/GET POST PUSH PUT	DELETE/],
		       content_type => ['text/html']
		   }
	       }

       restricted

       The restricted attribute	holds a	hasherf	of restricted
       domain/contraints.

	   my  $control	= Scrappy::Scraper::Control->new;
	       $control->restricted;

	       e.g.

	       {
		   'www.foobar.com' => {
		       methods => [qw/GET POST PUSH PUT	DELETE/]
		   }
	       }

METHODS
   allow
	   my  $control	= Scrappy::Scraper::Control->new;
	       $control->allow('http://www.perl.org');
	       $control->allow('http://search.cpan.org', if => {
		       content_type => ['text/html', 'application/x-tar']
		   }
	       );

   restrict
	   my  $control	= Scrappy::Scraper::Control->new;
	       $control->restrict('http://www.perl.org');
	       $control->restrict('http://search.cpan.org', if => {
		       content_type => ['text/html', 'application/x-tar']
		   }
	       );

   is_allowed
	   my  $control	= Scrappy::Scraper::Control->new;
	       $control->allow('http://search.cpan.org');
	       $control->restrict('http://www.perl.org');

	       if (! $control->is_allowed('http://perl.org')) {
		   die 'Cant get to Perl.org';
	       }

AUTHOR
       Al Newkirk <awncorp@cpan.org>

COPYRIGHT AND LICENSE
       This software is	copyright (c) 2010 by awncorp.

       This is free software; you can redistribute it and/or modify it under
       the same	terms as the Perl 5 programming	language system	itself.

perl v5.32.0			  2011-07-28	  Scrappy::Scraper::Control(3)

NAME | VERSION | SYNOPSIS | DESCRIPTION | METHODS | AUTHOR | COPYRIGHT AND LICENSE

Want to link to this manual page? Use this URL:
<https://www.freebsd.org/cgi/man.cgi?query=Scrappy::Scraper::Control&sektion=3&manpath=FreeBSD+12.2-RELEASE+and+Ports>

home | help