[tapx-dev] Test::Harness 3.0

[Andrew Dougherty]

On Mon, 23 Jul 2007, Ovid wrote:

> ----- Original Message ----
From: Andy Dougherty <doughera at lafayette.edu>

> It looks like my counting bug 
>    http://rt.cpan.org/Public/Bug/Display.html?id=27377
> is still there.

TAP::Parser does not have that counting bug:

> Testing with 5.8.8, I also got the following warning:
>
>    t/00compile.........# Testing Test::Harness 2.65_01 under Perl 5.008008 
>    and Test::More 0.42
>    Argument "2.65_01" isn't numeric in subroutine entry at t/lib/Test/More.pm 
>    line 670

I think you're testing Test::Harness and not TAP::Parser, the intended 
replacement (it will be renamed to Test::Harness, of course).  Sorry if I 
wasn't clear on that point.

Yes, that's exactly right.  Sorry for my confusion there.  I clicked on 
the wrong link.

So, suitably embarrassed, I went and downloaded TAP::Parser from CPAN and 
got version 0.52.  It does still display the double-counting bug.  I put 
my test script into t/countingbug.t, ran

	perl5.9.5 Makefile.PL
	make
	make test

and got the following.  If you look at the summary line for countingbug.t, 
you'll see it's claiming 7 failed tests.  It has double-counted tests 5 
and 6, which were never even attempted.

PERL_DL_NONLAZY=1 /home/doughera/my/perl/bin/perl5.9.5 "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t t/compat/*.t
t/000-load......................# Testing TAP::Parser 0.52, Perl 5.009005, /home/doughera/my/perl/bin/perl5.9.5
ok
t/010-base......................ok
t/020-regression................ok
t/030-grammar...................
#   Failed test '... and it should contain the correct data'
#   at t/030-grammar.t line 111.
#     Structures begin differing at:
#          $got->{explanation} = ''
#     $expected->{explanation} = 'why not?'

#   Failed test '... and it should contain the correct data'
#   at t/030-grammar.t line 135.
#     Structures begin differing at:
#          $got->{directive} = ''
#     $expected->{directive} = 'SKIP'
# Looks like you failed 2 tests of 69.
dubious
	Test returned status 2 (wstat 512, 0x200)
DIED. FAILED tests 43, 48
	Failed 2/69 tests, 97.10% okay
t/040-parse.....................ok
t/050-bailout...................ok
t/060-errors....................ok
t/070-streams...................ok
t/080-aggregator................ok
t/090-callbacks.................ok
t/100-premature-bailout.........ok
t/110-iterators.................ok
t/120-harness...................ok
t/130-source....................ok
t/140-results...................ok
t/150-yamlish...................ok
t/160-yamlish-writer............ok
t/170-yamlish-output............ok
t/compat/00compile..............# Testing TAP::Harness::Compatible 0.52 under Perl 5.009005 and Test::More 0.42
ok
t/compat/failure................ok
t/compat/inc_taint..............ok
t/compat/nonumbers..............ok
t/compat/ok.....................ok
t/compat/test-harness-compat....ok
t/compat/version................ok
t/countingbug...................
#   Failed test at t/countingbug.t line 10.

#   Failed test at t/countingbug.t line 11.

#   Failed test at t/countingbug.t line 12.
unexpected crash! at t/countingbug.t line 13.
# Looks like you planned 6 tests but only ran 4.
# Looks like you failed 3 tests of 4 run.
# Looks like your test died just after 4.
dubious
	Test returned status 255 (wstat 65280, 0xff00)
DIED. FAILED tests 2-6
	Failed 5/6 tests, 16.67% okay
t/pod-coverage..................skipped
        all skipped: Test::Pod::Coverage 1.04 required for testing POD coverage
t/pod...........................skipped
        all skipped: Test::Pod 1.14 required for testing POD
Failed Test     Stat Wstat Total Fail  List of Failed
-------------------------------------------------------------------------------
t/030-grammar.t    2   512    69    2  43 48
t/countingbug.t  255 65280     6    7  2-6
2 tests skipped.
Failed 2/28 test scripts. 7/4621 subtests failed.
Files=28, Tests=4621,  7 wallclock secs ( 4.55 cusr +  0.47 csys =  5.02 CPU)
Failed 2/28 test programs. 7/4621 subtests failed.
make: *** [test_dynamic] Error 255

-- 
    Andy Dougherty		doughera at lafayette.edu