UNKNOWN despite only failing tests -- how come?

Andy Armstrong andy at hexten.net
Tue Dec 11 14:26:47 EST 2007


On 11 Dec 2007, at 14:18, David Golden wrote:
> ExtUtils::MakeMake and Module::Build  treat test.pl differently.
> EU::MM just runs it and uses the exit code.  M::B passes it to
> Test::Harness.  Thus, a test.pl with no output (i.e no plan) has
> different behavior under each:
>
> * test.pl, no output, exit 0 -> EU::MM says pass, M::B says unknown
> * test.pl, no output, exit 1 -> EU::MM says fail, M::B says unknown
>
> (This is what t/54_test_report_split.t in CPAN::Reporter checks for.)

T::H currently works on the premise that if you run a test and it  
outputs nothing it's failed. I guess we could special-case test.pl but  
that's messy - would be good if we could avoid that.

> Overall, I'd prefer if Test::Harness releases that changed the
> definition of failure were released in a developer version first so we
> could try to catch and discuss these things earlier.  Running
> CPAN::Reporter tests against T::H dev releases should help catch any
> behavior changes -- I've tried to capture as many test/output
> scenarios as possible.  (See t/dist/ in CPAN::Reporter.)

I'm really sorry about that David. It was a dumb thing to do - no  
excuses. I'll make sure it doesn't happen again.

-- 
Andy Armstrong, Hexten






More information about the tapx-dev mailing list