Grokbase Groups Perl qa October 2014
FAQ
In accordance with the terms of my grant from TPF this is the final report for
my work on improving Devel::Cover.

Since the last report I have released versions 1.16 and 1.17.

The stable release of perl 5.20.1 along with development releases up to 5.21.4
have come out, and are all supported fully in Devel::Cover.

Additionally, and probably most importantly, cpancover.com is now fully up and
running. For some value of fully.

http://cpancover.com is a site to display coverage information for CPAN modules.
Previously this was for only a fairly small subset of CPAN modules, although I
had tried to make it a relevant subset. Now, coverage is reported for all
current CPAN modules, both stable and development releases, and coverage
information for previous modules is not deleted. Of course, the coverage
information is only available if the module can be installed, and the tests can
be run on the server I am using.

On that subject, the server has been kindly donated by Bytemark. It is one of
their bigv servers and runs Ubuntu 14.04. In order to cover all of CPAN I
needed more disk space, and Bytemark very graciously agreed to the increase here
too.

The coverage process runs continuously, looking for newly uploaded CPAN modules
and then calculating their coverage. New CPAN modules are found using
CPAN::Releases::Latest by Neil Bowers with index caching turned off.

In addition to the usual HTML coverage reports, there are also JSON files
available if someone just wants the raw data. There is a top-level file at
http://cpancover.com/latest/cpancover.json detailing which modules have been
covered and the summary coverage information.

Then there is a JSON file for each covered module providing run and file-level
coverage information. For example the aforementioned CPAN::Releases::Latest has
http://cpancover.com/latest/CPAN-Releases-Latest-0.06/cover.json

With all this in place, plans are under way to make the information available on
the metacpan. See https://github.com/CPAN-API/metacpan-web/pull/1128 for the
details.

There is one big problem too! You have probably already noticed it if you have
followed the link to the site. When I only catered for a smallish subset of
modules, sticking them all in a table on the front page seemed quite reasonable.
Now, that table has over 25,000 rows, and the front page is anything but
reasonable.

So the HTML output needs to be reworked. I'm rather hoping that someone reading
this will think "I can probably do that, and I'd love to have a go." If that's
you, have a look at the current state of events on the ticket
https://github.com/pjcj/Devel--Cover/issues/102, and check out the existing code
https://github.com/pjcj/Devel--Cover/blob/master/lib/Devel/Cover/Collection.pm#L286
Feel free to ask questions on IRC. You can't miss the link on
https://metacpan.org/pod/Devel::Cover ;-) And if you do fancy working on this,
please make a note on the ticket to avoid duplication of effort, and prepare for
fame and fortune!

As usual, I made various other changes and fixes, applied patches and merged
pull requests.

This grant is now at an end. I delayed posting this final report because I
wanted cpancover.com to be up and running and, even with 16 CPUs, it took almost
a month for a complete coverage run of CPAN.

I believe the grant to have been successful. Over two years I have been able to
spend 400 hours working on Devel::Cover which, otherwise, I would not have been
able to do. 400 hours over two years may not sound much, and I suppose it's not
really very much - I could have completed that within a few months - but what
the grant gave me was the ability to take a few days every month to really
concentrate exclusively on Devel::Cover.

And that was the important aspect of the grant. Some problems are just too
involved to be able to solve by spending a few hours over a few evenings.
Sometimes a day or two of intense work is required.

I'm not sure that completing the entire grant in three months would have been as
beneficial either, although there would have been advantages and disadvantages
there. One big advantage of spreading the grant out was that many more people
were able to get involved in the project in various ways. It's still primarily
me, and I'm not surprised by that, but I think the project is a lot more
accessible than it was previously, although there's still plenty of work to be
done in that regard. I'm happy that quite a few people have contributed to the
project in one way or another.
https://github.com/pjcj/Devel--Cover/blob/master/Contributors

In September I spoke about building cpancover.com with Docker at the Swiss Perl
Workshop. I shall be reprising the presentation at the Austrian Perl Workshop.
Then I am looking forward to the QA Hackathon next spring. Of course, the
amount of time I'm able to spend on Devel::Cover will be reduced, but I shall
continue to maintain it and work on it as time permits, as I did before starting
the grant.

I'd like to offer my sincere thanks to everyone who made this grant possible.
This includes, but is not limited to, everyone who has contributed to TPF, those
who work with TPF and those who supported the grant request and, specifically,
Nicholas Clark for first suggesting the possibility of this grant, my grant
managers, Florian Ragwitz, Ricardo Signes and Christian Walde, Dan Wright for
dealing with the finances, Mark Keating for dealing with the reports, and Karen
Pauley for picking up anything that got dropped and keeping the whole thing on
track. And, of course, a big thank-you to everyone who contributed to the
project in any way at all; sending pull requests, filing bug reports, making
suggestions, reminding me to do things, commenting on my reports, or even just
taking an interest. I'm serious - thank-you everyone!

I have now finished off the final 9 hours and 35 minutes of the grant and
therefore my final report is:

Total hours worked on grant: 400:00


This report is also available at
http://blogs.perl.org/users/paul_johnson/2014/10/final-tpf-develcover-grant-report.html

--
Paul Johnson - paul@pjcj.net
http://www.pjcj.net

Search Discussions

  • Leon Timmermans at Oct 7, 2014 at 10:03 pm

    On Tue, Oct 7, 2014 at 11:42 PM, Paul Johnson wrote:

    In accordance with the terms of my grant from TPF this is the final report
    for
    my work on improving Devel::Cover.

    Since the last report I have released versions 1.16 and 1.17.

    The stable release of perl 5.20.1 along with development releases up to
    5.21.4
    have come out, and are all supported fully in Devel::Cover.

    Additionally, and probably most importantly, cpancover.com is now fully
    up and
    running. For some value of fully.

    http://cpancover.com is a site to display coverage information for CPAN
    modules.
    Previously this was for only a fairly small subset of CPAN modules,
    although I
    had tried to make it a relevant subset. Now, coverage is reported for all
    current CPAN modules, both stable and development releases, and coverage
    information for previous modules is not deleted. Of course, the coverage
    information is only available if the module can be installed, and the
    tests can
    be run on the server I am using.

    On that subject, the server has been kindly donated by Bytemark. It is
    one of
    their bigv servers and runs Ubuntu 14.04. In order to cover all of CPAN I
    needed more disk space, and Bytemark very graciously agreed to the
    increase here
    too.

    The coverage process runs continuously, looking for newly uploaded CPAN
    modules
    and then calculating their coverage. New CPAN modules are found using
    CPAN::Releases::Latest by Neil Bowers with index caching turned off.

    In addition to the usual HTML coverage reports, there are also JSON files
    available if someone just wants the raw data. There is a top-level file at
    http://cpancover.com/latest/cpancover.json detailing which modules have
    been
    covered and the summary coverage information.

    Then there is a JSON file for each covered module providing run and
    file-level
    coverage information. For example the aforementioned
    CPAN::Releases::Latest has
    http://cpancover.com/latest/CPAN-Releases-Latest-0.06/cover.json

    With all this in place, plans are under way to make the information
    available on
    the metacpan. See https://github.com/CPAN-API/metacpan-web/pull/1128 for
    the
    details.

    There is one big problem too! You have probably already noticed it if you
    have
    followed the link to the site. When I only catered for a smallish subset
    of
    modules, sticking them all in a table on the front page seemed quite
    reasonable.
    Now, that table has over 25,000 rows, and the front page is anything but
    reasonable.

    So the HTML output needs to be reworked. I'm rather hoping that someone
    reading
    this will think "I can probably do that, and I'd love to have a go." If
    that's
    you, have a look at the current state of events on the ticket
    https://github.com/pjcj/Devel--Cover/issues/102, and check out the
    existing code

    https://github.com/pjcj/Devel--Cover/blob/master/lib/Devel/Cover/Collection.pm#L286
    Feel free to ask questions on IRC. You can't miss the link on
    https://metacpan.org/pod/Devel::Cover ;-) And if you do fancy working on
    this,
    please make a note on the ticket to avoid duplication of effort, and
    prepare for
    fame and fortune!

    As usual, I made various other changes and fixes, applied patches and
    merged
    pull requests.

    This grant is now at an end. I delayed posting this final report because I
    wanted cpancover.com to be up and running and, even with 16 CPUs, it took
    almost
    a month for a complete coverage run of CPAN.

    I believe the grant to have been successful. Over two years I have been
    able to
    spend 400 hours working on Devel::Cover which, otherwise, I would not have
    been
    able to do. 400 hours over two years may not sound much, and I suppose
    it's not
    really very much - I could have completed that within a few months - but
    what
    the grant gave me was the ability to take a few days every month to really
    concentrate exclusively on Devel::Cover.

    And that was the important aspect of the grant. Some problems are just too
    involved to be able to solve by spending a few hours over a few evenings.
    Sometimes a day or two of intense work is required.

    I'm not sure that completing the entire grant in three months would have
    been as
    beneficial either, although there would have been advantages and
    disadvantages
    there. One big advantage of spreading the grant out was that many more
    people
    were able to get involved in the project in various ways. It's still
    primarily
    me, and I'm not surprised by that, but I think the project is a lot more
    accessible than it was previously, although there's still plenty of work
    to be
    done in that regard. I'm happy that quite a few people have contributed
    to the
    project in one way or another.
    https://github.com/pjcj/Devel--Cover/blob/master/Contributors

    In September I spoke about building cpancover.com with Docker at the
    Swiss Perl
    Workshop. I shall be reprising the presentation at the Austrian Perl
    Workshop.
    Then I am looking forward to the QA Hackathon next spring. Of course, the
    amount of time I'm able to spend on Devel::Cover will be reduced, but I
    shall
    continue to maintain it and work on it as time permits, as I did before
    starting
    the grant.

    I'd like to offer my sincere thanks to everyone who made this grant
    possible.
    This includes, but is not limited to, everyone who has contributed to TPF,
    those
    who work with TPF and those who supported the grant request and,
    specifically,
    Nicholas Clark for first suggesting the possibility of this grant, my grant
    managers, Florian Ragwitz, Ricardo Signes and Christian Walde, Dan Wright
    for
    dealing with the finances, Mark Keating for dealing with the reports, and
    Karen
    Pauley for picking up anything that got dropped and keeping the whole
    thing on
    track. And, of course, a big thank-you to everyone who contributed to the
    project in any way at all; sending pull requests, filing bug reports,
    making
    suggestions, reminding me to do things, commenting on my reports, or even
    just
    taking an interest. I'm serious - thank-you everyone!

    I have now finished off the final 9 hours and 35 minutes of the grant and
    therefore my final report is:

    Total hours worked on grant: 400:00


    This report is also available at

    http://blogs.perl.org/users/paul_johnson/2014/10/final-tpf-develcover-grant-report.html

    Thank you for your work on this :-)

    Leon
  • David E. Wheeler at Oct 8, 2014 at 3:54 am

    On Oct 7, 2014, at 2:42 PM, Paul Johnson wrote:

    In accordance with the terms of my grant from TPF this is the final report for
    my work on improving Devel::Cover.
    Friggin’ awesome, thanks Paul!

    Best,

    David
  • James E Keenan at Oct 8, 2014 at 11:44 am

    On 10/07/2014 05:42 PM, Paul Johnson wrote:
    In accordance with the terms of my grant from TPF this is the final report for
    my work on improving Devel::Cover.
    What a long, strange trip it's been!
    Since the last report I have released versions 1.16 and 1.17.

    The stable release of perl 5.20.1 along with development releases up to 5.21.4
    have come out, and are all supported fully in Devel::Cover.

    Additionally, and probably most importantly, cpancover.com is now fully up and
    running. For some value of fully.
    I look forward to making use of this new resource. Long live coverage
    analysis in Perl!

    Thank you very much.
    Jim Keenan
  • Steffen Schwigon at Oct 8, 2014 at 3:50 pm

    Paul Johnson writes:
    In accordance with the terms of my grant from TPF this is the final
    report for my work on improving Devel::Cover.
    This is amazing. It was fun and inspiring to follow your reports and
    your work over the last 2 years.

    Thanks!

    Kind regards,
    Steffen
    --
    Steffen Schwigon <ss5@renormalist.net>
    Dresden Perl Mongers <http://dresden-pm.org/>
  • Shlomi Fish at Oct 10, 2014 at 6:38 am

    On Tue, 7 Oct 2014 22:42:41 +0100 Paul Johnson wrote:

    In accordance with the terms of my grant from TPF this is the final report for
    my work on improving Devel::Cover.

    Since the last report I have released versions 1.16 and 1.17.
    Thanks for all your work, Paul!

    Regards,

      Shlomi Fish

    --
    -----------------------------------------------------------------
    Shlomi Fish http://www.shlomifish.org/
    Parody of "The Fountainhead" - http://shlom.in/towtf

    When Chuck Norris orders Pizza, it arrives before he presses the OK button.
         — http://www.shlomifish.org/humour/bits/facts/Chuck-Norris/

    Please reply to list if it's a mailing list post - http://shlom.in/reply .
  • Matthew Horsfall (alh) at Oct 13, 2014 at 2:05 pm
    This is awesome Paul. Thanks so much for all of this.

    -- Matthew Horsfall (alh)

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupqa @
categoriesperl
postedOct 7, '14 at 9:42p
activeOct 13, '14 at 2:05p
posts7
users7
websiteqa.perl.org

People

Translate

site design / logo © 2019 Grokbase