The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

Changes for version 0.01 - 2018-05-14

  • original version; created by h2xs 1.23 with options -AX TaskPipe

Documentation

An overview of the TaskPipe framework
script to execute the TaskPipe Tool

Modules

A task management framework for building web scrapers and crawlers
manage TaskPipe background processes
handles file installs for TaskPipe
Parameter value interpolator for TaskPipe
handling matching of parameter values in the plan
generic class for TaskPipe Iterators
manages TaskPipe jobs
settings for the TaskPipe::JobManager module
Logging manager for TaskPipe
settings for the TaskPipe::LoggerManager module
open proxy management for TaskPipe
the base class for IPLists
Path settings for TaskPipe
TaskPipe global path settings
project path settings for TaskPipe
manage plan files for TaskPipe
settings for TaskPipe::Plan
read POD for TaskPipe
Settings for TaskPipe::PodReader
manage ports for TaskPipe
manage schema connections for TaskPipe
settings for TaskPipe::SchemaManager
global schema settings for TaskPipe
project schema settings for TaskPipe
Global Schema Template for TaskPipe
Global Schema Template file for port source
Project Schema Template for TaskPipe
the class which all TaskPipe tasks should inherit from
Settings for TaskPipe::Task
test settings for TaskPipe::Task
record a record to the database
Base TaskPipe class for scraping a webpage
settings for TaskPipe::Task_Scrape
use a database table as the data source
use a file as a data source
the base class for file templates
template for the global config file
template for the project config
the template package for the 'system' config file
manages threads for TaskPipe
the base class for the TaskPipe command line tool
base class for TaskPipe Tool commands
manage TOR processes for TaskPipe
settings for TaskPipe::TorManager
base class for managing requests in TaskPipe
base class for proxying useragents
useragent manager for making requests through an open proxy network
useragent manager for making requests through TOR

Provides

in lib/TaskPipe/InterpParam/MatchHandler_this.pm
in lib/TaskPipe/OpenProxyManager/IPList/Settings.pm
in lib/TaskPipe/OpenProxyManager/IPList_PremProxy/Settings.pm
in lib/TaskPipe/OpenProxyManager/IPList_ProxyNova/Settings.pm
in lib/TaskPipe/OpenProxyManager/IPList_Xroxy/Settings.pm
in lib/TaskPipe/OpenProxyManager/Settings.pm
in lib/TaskPipe/Sample.pm
in lib/TaskPipe/Sample_SP500.pm
in lib/TaskPipe/Sample_Stubs.pm
in lib/TaskPipe/SchemaTemplate_Global/Result/Daemon.pm
in lib/TaskPipe/SchemaTemplate_Project_SP500.pm
in lib/TaskPipe/SchemaTemplate_Project_SP500/Result/Company.pm
in lib/TaskPipe/Task_Record_NameValuePairs.pm
in lib/TaskPipe/Template_Config_Project_SP500.pm
in lib/TaskPipe/Template_Plan.pm
in lib/TaskPipe/Template_Plan_SP500.pm
in lib/TaskPipe/Template_Plan_Stub.pm
in lib/TaskPipe/Template_Task.pm
in lib/TaskPipe/Template_Task_SP500ScrapeCompanies.pm
in lib/TaskPipe/Template_Task_SP500ScrapeQuote.pm
in lib/TaskPipe/Template_Task_ScrapeStub.pm
in lib/TaskPipe/Tool/Command_ClearTables.pm
in lib/TaskPipe/Tool/Command_DeployFiles.pm
in lib/TaskPipe/Tool/Command_DeployTables.pm
in lib/TaskPipe/Tool/Command_GenerateSchema.pm
in lib/TaskPipe/Tool/Command_RunPlan.pm
in lib/TaskPipe/Tool/Command_Setup.pm
in lib/TaskPipe/Tool/Command_ShowJobs.pm
in lib/TaskPipe/Tool/Command_StopJob.pm
in lib/TaskPipe/Tool/Command_TestTask.pm
in lib/TaskPipe/Tool/Command__OpenProxies_FetchOpenProxies.pm
in lib/TaskPipe/Tool/Command__OpenProxies_TestOpenProxies.pm
in lib/TaskPipe/Tool/Options.pm
in lib/TaskPipe/UserAgentManager/UserAgentHandler_WhoIs.pm