Back
From: metabase:user:320bfe00-2aae-11df-837a-5e0a49663a4f
Subject: FAIL Scraper-3.05 v5.22.2 GNU/Linux
Date: 2017-03-03T00:08:03Z
This distribution has been tested as part of the CPAN Testers
project, supporting the Perl programming language. See
http://wiki.cpantesters.org/ for more information or email
questions to cpan-testers-discuss@perl.org
--
Dear Glenn Wood,
This is a computer-generated report for Scraper-3.05
on perl 5.22.2, created by CPAN-Reporter-1.2018.
Thank you for uploading your work to CPAN. However, there was a problem
testing your distribution.
If you think this report is invalid, please consult the CPAN Testers Wiki
for suggestions on how to avoid getting FAIL reports for missing library
or binary dependencies, unsupported operating systems, and so on:
http://wiki.cpantesters.org/wiki/CPANAuthorNotes
Sections of this report:
* Tester comments
* Program output
* Prerequisites
* Environment and other context
------------------------------
TESTER COMMENTS
------------------------------
Additional comments from tester:
this report is from an automated smoke testing program
and was not reviewed by a human for accuracy
------------------------------
PROGRAM OUTPUT
------------------------------
Output from '/usr/bin/make test':
PERL_DL_NONLAZY=1 "/home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/bin/perl" "-Iblib/lib" "-Iblib/arch" test.pl
# VERSIONS OF MODULES ON WHICH SCRAPER DEPENDS
# using HTML::Form(6.03);
# using HTML::TreeBuilder();
# using HTTP::Cookies(6.01);
# using HTTP::Request(6.11);
# using HTTP::Response(6.11);
# using HTTP::Status(6.11);
# using LWP(6.22);
# using LWP::RobotUA(6.22);
# using LWP::UserAgent(6.22);
# using Storable(3.05);
# using Text::ParseWords(3.30);
# using Tie::Persistent(1.00);
# using URI(1.71);
# using URI::Escape(3.31);
# using URI::URL(5.04);
# using URI::http(1.71);
# using User(1.9);
# using WWW::Search(2.565);
# using XML::XPath(1.40);
1..11
ok 1 - 9 Scraper modules listed in MANIFEST (4,0,5)
ok 2 - WWW::Scraper loaded
ok 3 # skip This Scraper engine requires 'HTML Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'
Make sure it is in your execution search path.
Use of uninitialized value in pattern match (m//) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 1294.
Use of uninitialized value in pattern match (m//) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 1294.
Use of uninitialized value in pattern match (m//) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 1294.
Use of uninitialized value in pattern match (m//) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 1294.
not ok 4 - CraigsList
# Failed test (test.pl at line 129)
ok 5 # skip This Scraper engine requires 'HTML Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'
Make sure it is in your execution search path.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 916.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 916.
not ok 6 - Google
# Failed test (test.pl at line 129)
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 916.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 916.
not ok 7 - Lycos
# Failed test (test.pl at line 129)
ok 8 # skip NorthernLight's search engine seems to be down these days!?
ok 9 # skip Sherlock.pm is not working today; many changes out on the frontier that I haven't caught up with yet
ok 10 # skip WSDL is still in a primitive experimental state.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 916.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 915.
Use of uninitialized value $_ in substitution (s///) at /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/WWW/Search.pm line 916.
not ok 11 - ZIPplus4
# Failed test (test.pl at line 129)
# Can't locate object method "state" via package "WWW::Scraper::Request::ZIPplus4_" at blib/lib/WWW/Scraper/Request.pm line 207.
# 4 tests had problems. See file 'test.trace' for details.
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Operating system: linux
Perl version: 5.022002
VERSIONS OF MODULES ON WHICH SCRAPER DEPENDS
using HTML::Form(6.03);
using HTML::TreeBuilder();
using HTTP::Cookies(6.01);
using HTTP::Request(6.11);
using HTTP::Response(6.11);
using HTTP::Status(6.11);
using LWP(6.22);
using LWP::RobotUA(6.22);
using LWP::UserAgent(6.22);
using Storable(3.05);
using Text::ParseWords(3.30);
using Tie::Persistent(1.00);
using URI(1.71);
using URI::Escape(3.31);
using URI::URL(5.04);
using URI::http(1.71);
using User(1.9);
using WWW::Search(2.565);
using XML::XPath(1.40);
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
LIST SCRAPER SUB-CLASSES, FROM THE MANIFEST
+ Beaucoup(1.07)
+ CraigsList(1.16)
+ Dogpile(1.11)
- FieldTranslation will not be tested: it is not a Scraper sub-class.
+ Google(1.23)
- Grub will not be tested: it is not a Scraper sub-class.
+ Lycos(1.00)
+ NorthernLight(1.00)
+ Sherlock(1.00)
- Response will not be tested: it is not a Scraper sub-class.
- Request will not be tested: it is not a Scraper sub-class.
- TidyXML will not be tested: it is not a Scraper sub-class.
+ WSDL(1.00)
+ ZIPplus4(1.09)
- Opcode will not be tested: it is not a Scraper sub-class.
- ScraperDiscovery will not be tested: it is not a Scraper sub-class.
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: CraigsList
Test #1: CraigsList 'bogus' search
Test #2: CraigsList one-page search
+ got 0 results for 'Honda'
--- got 0 results for CraigsList 'Honda', but expected 50
--- base URL: http://www.craigslist.org/cgi-bin/search?
--- first URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
--- last URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
--- next URL:
--- response message: 404 Not Found
--- content size (bytes): 4975
--- ERRNO:
--- Extended OS error:
Scraper engine CraigsList failed once:
Test #0: CraigsList
Test #1: CraigsList 'bogus' search
Test #2: CraigsList one-page search
+ got 0 results for 'Honda'
--- got 0 results for CraigsList 'Honda', but expected 50
--- base URL: http://www.craigslist.org/cgi-bin/search?
--- first URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
--- last URL: http://www.craigslist.org/cgi-bin/search?areaID=1&cat=all&catAbbreviation=car&group=J&max_ask=&min_ask=&new_cat=6&query=Honda&subAreaID=0&type_search=
--- next URL:
--- response message: 404 Not Found
--- content size (bytes): 4975
--- ERRNO:
--- Extended OS error:
Scraper engine CraigsList failed twice:
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: Google
Test #1: Google 'bogus' search
Test #2: Google one-page search
+ got 0 results for 'search scraper'
--- got 0 results for Google 'search scraper', but expected 9
--- base URL: http://www.google.com/search?
--- first URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
--- last URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
--- next URL:
--- response message: 503 Service Unavailable
--- content size (bytes): 3069
--- ERRNO:
--- Extended OS error:
Scraper engine Google failed once:
Test #0: Google
Test #1: Google 'bogus' search
Test #2: Google one-page search
+ got 0 results for 'search scraper'
--- got 0 results for Google 'search scraper', but expected 9
--- base URL: http://www.google.com/search?
--- first URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
--- last URL: http://www.google.com/search?btnG=Google+Search&hl=en&ie=UTF%2D8&lr=&q=search+scraper&safe=active
--- next URL:
--- response message: 503 Service Unavailable
--- content size (bytes): 3070
--- ERRNO:
--- Extended OS error:
Scraper engine Google failed twice:
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: Lycos
Test #1: Lycos 'bogus' search
Test #2: Lycos one-page search
+ got 0 results for 'turntable'
--- got 0 results for Lycos 'turntable', but expected 9
--- base URL: http://search.lycos.com/default.asp?
--- first URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
--- last URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
--- next URL:
--- response message: 404 Not Found
--- content size (bytes): 9980
--- ERRNO:
--- Extended OS error:
Scraper engine Lycos failed once:
Test #0: Lycos
Test #1: Lycos 'bogus' search
Test #2: Lycos one-page search
+ got 0 results for 'turntable'
--- got 0 results for Lycos 'turntable', but expected 9
--- base URL: http://search.lycos.com/default.asp?
--- first URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
--- last URL: http://search.lycos.com/default.asp?loc=searchhp&lpv=1&query=turntable&tab=web
--- next URL:
--- response message: 404 Not Found
--- content size (bytes): 9972
--- ERRNO:
--- Extended OS error:
Scraper engine Lycos failed twice:
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: ZIPplus4
Test #1: ZIPplus4 'bogus' search
Scraper engine ZIPplus4 failed once: Can't locate object method "zipcode" via package "WWW::Scraper::Request::ZIPplus4_" at blib/lib/WWW/Scraper/Request.pm line 207.
Test #0: ZIPplus4
Test #1: ZIPplus4 'bogus' search
Scraper engine ZIPplus4 failed twice: Can't locate object method "state" via package "WWW::Scraper::Request::ZIPplus4_" at blib/lib/WWW/Scraper/Request.pm line 207.
# Looks like you failed 4 tests of 11.
Makefile:1000: recipe for target 'test_dynamic' failed
make: *** [test_dynamic] Error 4
------------------------------
PREREQUISITES
------------------------------
Prerequisite modules loaded:
requires:
Module Need Have
------------------- ----- -----
HTML::Form 0.02 6.03
HTML::TreeBuilder 0 5.03
HTTP::Cookies 0 6.02
HTTP::Request 0 6.11
HTTP::Response 0 6.11
HTTP::Status 0 6.11
LWP 5.48 6.22
LWP::RobotUA 0 6.22
LWP::UserAgent 0 6.22
Storable 0.6 3.05
Text::ParseWords 3.2 3.30
Tie::Persistent 0.901 1.00
URI 0 1.71
URI::Escape 0 3.31
URI::http 0 1.71
URI::URL 0 5.04
User 1.05 1.9
WWW::Search 2.35 2.565
XML::XPath 0 1.40
build_requires:
Module Need Have
------------------- ----- -----
ExtUtils::MakeMaker 0 7.24
------------------------------
ENVIRONMENT AND OTHER CONTEXT
------------------------------
Environment variables:
AUTOMATED_TESTING = 1
LANG = en_US.UTF-8
PATH = /home/sand/bin:/usr/local/bin:/usr/bin:/bin:/usr/games:/usr/local/perl/bin:/usr/X11/bin:/sbin:/usr/sbin
PERL5LIB =
PERL5OPT =
PERL5_CPANPLUS_IS_RUNNING = 29081
PERL5_CPAN_IS_RUNNING = 29081
PERL_CANARY_STABILITY_NOPROMPT = 1
PERL_MM_USE_DEFAULT = 1
PERL_USE_UNSAFE_INC = 1
SHELL = /usr/bin/zsh
TERM = screen
Perl special variables (and OS-specific diagnostics, for MSWin32):
$^X = /home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/bin/perl
$UID/$EUID = 1005 / 1005
$GID = 1005 1005
$EGID = 1005 1005
Perl module toolchain versions installed:
Module Have
------------------- --------
CPAN 2.17
CPAN::Meta 2.150010
Cwd 3.62
ExtUtils::CBuilder 0.280224
ExtUtils::Command 7.24
ExtUtils::Install 2.04
ExtUtils::MakeMaker 7.24
ExtUtils::Manifest 1.70
ExtUtils::ParseXS 3.30
File::Spec 3.62
JSON 2.91_04
JSON::PP 2.91_04
Module::Build 0.4220
Module::Signature 0.81
Parse::CPAN::Meta 2.150010
Test::Harness 3.37_01
Test::More 1.302078
YAML 1.20
YAML::Syck 1.29
version 0.9917
--
Summary of my perl5 (revision 5 version 22 subversion 2) configuration:
Commit id: 9cbffb38735712e3a34e6f537892b6ef06fb815f
Platform:
osname=linux, osvers=4.8.0-2-amd64, archname=x86_64-linux
uname='linux k93msid 4.8.0-2-amd64 #1 smp debian 4.8.11-1 (2016-12-02) x86_64 gnulinux '
config_args='-Dprefix=/home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1 -Dmyhostname=k93msid -Dinstallusrbinperl=n -Uversiononly -Dusedevel -des -Ui_db -Dlibswanted=cl pthread socket inet nsl gdbm dbm malloc dl ld sun m crypt sec util c cposix posix ucb BSD gdbm_compat -Uuseithreads -Uuselongdouble -DDEBUGGING=both'
hint=recommended, useposix=true, d_sigaction=define
useithreads=undef, usemultiplicity=undef
use64bitint=define, use64bitall=define, uselongdouble=undef
usemymalloc=n, bincompat5005=undef
Compiler:
cc='cc', ccflags ='-fwrapv -DDEBUGGING -fno-strict-aliasing -pipe -fstack-protector-strong -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64',
optimize='-O2 -g',
cppflags='-fwrapv -DDEBUGGING -fno-strict-aliasing -pipe -fstack-protector-strong -I/usr/local/include'
ccversion='', gccversion='6.2.1 20161124', gccosandvers=''
intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678, doublekind=3
d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16, longdblkind=3
ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
alignbytes=8, prototype=define
Linker and Libraries:
ld='cc', ldflags =' -fstack-protector-strong -L/usr/local/lib'
libpth=/usr/local/lib /usr/lib/gcc/x86_64-linux-gnu/6/include-fixed /usr/include/x86_64-linux-gnu /usr/lib /lib/x86_64-linux-gnu /lib/../lib /usr/lib/x86_64-linux-gnu /usr/lib/../lib /lib
libs=-lpthread -lnsl -ldl -lm -lcrypt -lutil -lc
perllibs=-lpthread -lnsl -ldl -lm -lcrypt -lutil -lc
libc=libc-2.24.so, so=so, useshrplib=false, libperl=libperl.a
gnulibc_version='2.24'
Dynamic Linking:
dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='-Wl,-E'
cccdlflags='-fPIC', lddlflags='-shared -O2 -g -L/usr/local/lib -fstack-protector-strong'
Characteristics of this binary (from libperl):
Compile-time options: DEBUGGING HAS_TIMES PERLIO_LAYERS
PERL_DONT_CREATE_GVSV
PERL_HASH_FUNC_ONE_AT_A_TIME_HARD PERL_MALLOC_WRAP
PERL_NEW_COPY_ON_WRITE PERL_PRESERVE_IVUV
PERL_USE_DEVEL USE_64_BIT_ALL USE_64_BIT_INT
USE_LARGE_FILES USE_LOCALE USE_LOCALE_COLLATE
USE_LOCALE_CTYPE USE_LOCALE_NUMERIC USE_LOCALE_TIME
USE_PERLIO USE_PERL_ATOF
Built under linux
Compiled at Dec 14 2016 16:01:28
%ENV:
PERL5LIB=""
PERL5OPT=""
PERL5_CPANPLUS_IS_RUNNING="29081"
PERL5_CPAN_IS_RUNNING="29081"
PERL_CANARY_STABILITY_NOPROMPT="1"
PERL_MM_USE_DEFAULT="1"
PERL_USE_UNSAFE_INC="1"
@INC:
/home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2/x86_64-linux
/home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/site_perl/5.22.2
/home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/5.22.2/x86_64-linux
/home/sand/src/perl/repoperls/installed-perls/host/k93msid/v5.22.2/d2d1/lib/5.22.2
.