[tapx-dev] Automated test report for TAP::Parser r226

[Andy Armstrong]

On 10 Aug 2007, at 18:10, Andy Armstrong wrote:

> To obtain this release use the following command:
>
>   svn checkout -r226 http://svn.hexten.net/tapx/trunk
>
> === Test against perl 5.00504 ===
>
> passed: yes n | /home/andy/Works/Perl/versions/5.0.5/bin/perl  
> Makefile.PL
> passed: make
> passed: make test
> passed: /home/andy/Works/Perl/versions/5.0.5/bin/perl -Ilib bin/ 
> runtests -b t/*.t t/compat/*.t

This is the output of a script that runs every ten minutes on a(n)  
Ubuntu box here. It's probably reasonably clear what it's doing - if  
there's a new revision in SVN then for each version of Perl I've  
installed it checks it out into a clean directory, builds and tests  
it via Makefile.PL, runs the test suite through the just built  
TAP::Parser and reports the results.

We only see a failure when one of the commands exits with non-zero  
status - so we won't see any harmless warnings from the build process  
for example.

In combination with Leif's ongoing efforts to get the coverage up to  
100% it means we're getting pretty thorough testing. Ideally though  
I'd like to be smoking on at least Windows as well. I don't really  
have a spare box to devote to Windows at the moment - but if I can  
find a spare PC I'll set that up too.

I think I'll probably spin this script off into its own module  
(Test::SmokeStack is the provisional name) and generalise it - even  
the config is currently hardwired into the script.

-- 
Andy Armstrong, hexten.net