[PHP-INTERNALS] php 5.2.4 test results reference

Not grouped, but we do have all the test results here:
http://news.php.net/php.qa

regards,
Derick

Hi Derick

many thks for the pointer

going thru this link, there are hundreds of reports posted !!! can not
go thru all of them

most of the reports opened are for Linux

didn't find any dedicated to Solaris (but for sure assuming they exist)

parsing results, tests failed may vary (even if noticing same failed
tests often occur)

i have the following naive question : how can get a reference of test
results

smth to be able to find :

such set of test case id MUST pass
such set test case id MUST fail
such set test case id skip if such extension missing etc,...



thks
Jean

Derick Rethans wrote On 10/17/07 02:41 PM,:

Well, they should all pass - skipped tests depends totally on the
configuration - I don't think we've any information on that at all.

regards,
Derick

as catching 50 failed tests for php 5.2.4 / 5.11

for failed tests can someone tell the action to take ?

- report a new bug at php org level for this php release ?
- integration problem specific to OS (eg implementation specifities) ?
- other ?


rgds,
Jean


Derick Rethans wrote On 10/17/07 03:51 PM,:

Figure out the reason and act accordingly.
If it's a problem caused by some Solaris-specific behaviour and we're missing a
workaround for it (which is obvious for you) - send us a patch.
If the test is wrong - report it to the php.qa list (or here).
If there is a bug in PHP - report to bugs.php.net.

Jean - if the tests don't pass on your system it would be helpful if you
could raise defects (http://bugs.php.net/) checking first to make sure
that someone hasn't already done so, and make the .diff and .out files
available. In some cases when we write tests it isn't possible to test
on ALL platforms, so sometimes the tests may fail because they really
should not pass on a specific platform (if so we will fix by adding a
--SKIPIFF-- to the test case), sometimes it's because of an
implementation difference - we can't tell till we see the output from
the test.

As Derick says, they should all pass :-)

Zoe

In addition to what Derick said, there is a "reference" build and test
failure at http://gcov.php.net

Nuno

Hello Nuno,

we should work on that database thing that collects information from
trusted gcov machines.....

marcus

Wednesday, October 17, 2007, 11:03:47 PM, you wrote:



Best regards,
Marcus

I know, I know.. It is on my TODO list for a loong time. I have the program
on my head, I just need to get some time to sit and code it..

BTW: Jean, would Sun be interested in setting up a build machine to run the
PHP test suite and post the results to a central build DB?

Nuno

(resending this message as got return errors)


Thanks Nuno for this proposition

for sure Sun is very interested in publishing/sharing the test results
of integrating PHP 5.2.4 in its OpenSolaris version (Solaris Express
Developer Edition, SXDE)

fyi, the PHP 5.2.4 test suite has already been executed on a platform
with SXDE build : plan is to include other OSS components like Apache,
MySQL, Squid, etc,...to complete the web-base stack called Sun WebStack

same php test suite has been executed on Red Hat 4 to establish a
comparison of tests results (building PHP with the same way of course on
these 2 OS)

as test results have not been yet reported to PHP QA, can we share with
you the results obtained ?

we would like to know whether possible to get your help to analyze the
reasons of the test failures (tests results of PHP 5.2.4 for SXDE OS are
inclosed)

we have been said all tests should pass

before filing any php bug we would like to know if failures are due to
tests issues requesting test updates/patches, integration issues from
us, Solaris specificities, real php bugs for 5.2.4 release etc,...


thanks in advance for your support
Jean



Nuno Lopes wrote On 10/18/07 11:24 PM,: