dev@javaserverfaces.java.net

Re: Still closed Re: Please hold external commits to master until at least Thursday

From: Edward Burns <edward.burns_at_oracle.com>
Date: Fri, 25 Sep 2015 08:05:44 -0700

>>>>>>> On Tue, 22 Sep 2015 11:37:51 -0700, Edward Burns <edward.burns_at_oracle.com> said:

EB> I'm sorry but I do not have good news on the ADF test front. I was
EB> hoping to integrate JAVASERVERFACES_SPEC_PUBLIC-1 to master today but
EB> the following ADF numbers cause me to have to pursue cleaning the
EB> numbers up first.

>>>>> On Thu, 24 Sep 2015 23:11:25 +0200, arjan tijms <arjan.tijms_at_gmail.com> said:

AT> What are the ADF tests exactly testing? Is this something I can setup
AT> and run locally, so I can test any change on those tests too before
AT> committing anything?

Those tests are closed source so that's not possible. In fact, I
would have to undertake some non-trivial effort to get access to them
myself even!

On Thu, Sep 24, 2015 at 9:26 PM, Edward Burns <edward.burns_at_oracle.com> wrote:

EB> The bottom line is that the NWDIF numbers on the 2.3.0-X line must be
EB> similar to what we see on the 2.2.8-X line. We can see that as of the
EB> 20150920 run they started to diverge badly.

AT> A few questions here:

AT> Are there 11~15 tests failing all the time? What are they failing
AT> on?

It varies from run to run. The tests have many external dependencies
and are sometimes prey to environmental factors.

AT> What happened on 20150911? That's the highest number in this snapshot
AT> of runs, but it went back to 11 two days after

I'm going to attribute that to an environmental factor, such as a
dependent database connection not responding as expected.

EB> I inspected the commits to 2.3 master in the range 2015-09-15 -
EB> 2015-09-22. In that range, commits came from the following individuals
EB> (with the type of commit):

AT> In the table it seems that things diverged from 20150920, and the last
AT> run before that is 20150918. The Mojarra timestamp is a little
AT> behind; 20150917.

AT> How are the commits from 2015-09-15 related to this?

The job that generates the Mojarra build that feeds into these tests
ends up running after every commit to 2.3 master. The tests themselves
run every day, but the Mojarra they pick up alternates between the
2.2.8-X and 2.3.0-X lines.

Ed

-- 
| edward.burns_at_oracle.com | office: +1 407 458 0017
| 30 Business days til JavaOne 2015
| 45 Business days til DOAG 2015