[tapx-dev] Tracking tests over time

[Michael Peters]

Andy Armstrong wrote:
> I've just noticed that the MediaWiki team have a test harness that
> tracks the life of individual assertions over time:
> 
>     * HTML nested bullet list, open tags (bug 5497)  [Has never passed]
>     * HTML nested ordered list, open tags (bug 5497)  [Has never passed]
>     * Fuzz testing: image with bogus manual thumbnail  [Introduced
> between 08-Apr-2007 07:15:22, 1.10alpha (r21099) and 25-Apr-2007
> 07:15:46, 1.10alpha
> 
> Nice eh?
> 
> With TAP that'd require either adding a persistent identifier to tests,
> requiring that the test numbering doesn't change over time (new tests
> added at the end) or that there's some heuristic that attempts to track
> assertions that have been renumbered.

Why can't you just use test names?

  ok($is_ok, 'HTML nested bullet list, open tags (bug 5497)');

If tracking a single test over time seems like something people would want, I
think it could be added to Smolder without too much difficulty.

-- 
Michael Peters
Developer
Plus Three, LP