Parallel thoughts

[Ovid]

--- Eric Wilhelm <scratchcomputing at gmail.com> wrote:

> I realize the below implementation is an oversimplification, but
> given 
> that we seem to be stuck on the subject of the parser speed, I think
> it 
> is worth noting that "parses_tap.pl" parses the Regexp::Common
> archive 
> in 0.4s while the `runtests -r --exec cat $spooldir` takes 38s. 
> That's 
> missing some features, but it's about 7500% faster.
> 
>   http://scratchcomputing.com/tmp/parses_tap.pl

Yes, that does parse TAP a heck of a lot faster.  It also parses a lot
of things which aren't TAP.  In fact, it's so far removed from a TAP
parser that I don't think it's anywhere close to a fair comparison. 
Speeding up the actual parsing is clearly a desirable goal, but that's
orthogonal to the goal of having parallel test runs.  Each is useful
independent of the other.

Cheers,
Ovid
 
> Does it have 7500% more features?
> 
> The simple parser is still 3500% faster than the --fork -j 9.  Given
> the 
> complexity of the IPC and the growing complexity of Harness.pm with
> all 
> of these embedded features (and it still has no nonblock mode for the
> 
> gui subclass), I'm not liking the direction that things seem to be 
> headed.
> 
> And for the dotreader test suite, the --fork slows it down by about
> 11%.
> 
> --Eric
> -- 
> So malloc calls a timeout and starts rummaging around the free chain,
> sorting things out, and merging adjacent small free blocks into
> larger
> blocks. This takes 3 1/2 days.
> --Joel Spolsky
> ---------------------------------------------------
>     http://scratchcomputing.com
> ---------------------------------------------------
> _______________________________________________
> tapx-dev mailing list
> tapx-dev at hexten.net
> http://www.hexten.net/mailman/listinfo/tapx-dev
> cpan: http://search.cpan.org/dist/TAP-Parser/
> bugs: http://rt.cpan.org/Public/Dist/Display.html?Name=TAP-Parser
> 


--
Buy the book  - http://www.oreilly.com/catalog/perlhks/
Perl and CGI  - http://users.easystreet.com/ovid/cgi_course/
Personal blog - http://publius-ovidius.livejournal.com/
Tech blog     - http://use.perl.org/~Ovid/journal/