Grokbase Groups Lucene dev June 2016
FAQ
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1196/

20 tests failed.
FAILED: org.apache.solr.cloud.BasicZkTest.testBasic

Error Message:
No registered leader was found after waiting for 30000ms , collection: collection1 slice: shard1

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 30000ms , collection: collection1 slice: shard1
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:D81164029CDCF4F2]:0)
  at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:718)
  at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:685)
  at org.apache.solr.cloud.BasicZkTest.testBasic(BasicZkTest.java:51)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.DistribCursorPagingTest.test

Error Message:
Error from server at http://127.0.0.1:52817/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 503 </title> </head> <body> <h2>HTTP ERROR: 503</h2> <p>Problem accessing /collection1/update. Reason: <pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/> </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52817/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /collection1/update. Reason:
<pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/>
</body>
[73EB7917430072DC:FBBF46CDEDFC1F24]:0)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
  at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.del(AbstractFullDistribZkTestBase.java:835)
  at org.apache.solr.cloud.DistribCursorPagingTest.doBadInputTest(DistribCursorPagingTest.java:114)
  at org.apache.solr.cloud.DistribCursorPagingTest.test(DistribCursorPagingTest.java:88)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection

Error Message:
Could not start container:7000. Reason:class org.apache.solr.common.SolrException Error CREATEing SolrCore 'collection1_shard1': Unable to create core [collection1_shard1] Caused by: Timed out getting coreNodeName for collection1_shard1

Stack Trace:
java.lang.AssertionError: Could not start container:7000. Reason:class org.apache.solr.common.SolrException Error CREATEing SolrCore 'collection1_shard1': Unable to create core [collection1_shard1] Caused by: Timed out getting coreNodeName for collection1_shard1
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:2DDFB459007FEE3B]:0)
  at org.junit.Assert.fail(Assert.java:93)
  at org.apache.solr.cloud.LeaderElectionIntegrationTest.setUp(LeaderElectionIntegrationTest.java:102)
  at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:905)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionIntegrationTest

Error Message:
12 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionIntegrationTest: 1) Thread[id=9512, name=zkCallback-1699-thread-5, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=9502, name=TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[73EB7917430072DC]-EventThread, state=WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 3) Thread[id=9510, name=zkCallback-1699-thread-3, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=9504, name=OverseerStateUpdate-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:102) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:328) at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(DistributedQueue.java:309) at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQueue.java:288) at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQueue.java:357) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:142) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:196) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=9509, name=zkCallback-1699-thread-2, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=9511, name=zkCallback-1699-thread-4, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=9496, name=Connection evictor, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:745) 8) Thread[id=9507, name=Thread-3280, state=WAITING, group=TGRP-LeaderElectionIntegrationTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1276) 9) Thread[id=9505, name=OverseerCollectionConfigSetProcessor-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:102) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:345) at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:328) at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:167) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=9506, name=OverseerHdfsCoreFailoverThread-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137) at java.lang.Thread.run(Thread.java:745) 11) Thread[id=9497, name=Connection evictor, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:745) 12) Thread[id=9501, name=TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[73EB7917430072DC]-SendThread(127.0.0.1:45238), state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 12 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionIntegrationTest:
    1) Thread[id=9512, name=zkCallback-1699-thread-5, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    2) Thread[id=9502, name=TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[73EB7917430072DC]-EventThread, state=WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
    3) Thread[id=9510, name=zkCallback-1699-thread-3, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    4) Thread[id=9504, name=OverseerStateUpdate-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]
         at java.lang.Thread.sleep(Native Method)
         at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:102)
         at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
         at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:328)
         at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(DistributedQueue.java:309)
         at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQueue.java:288)
         at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQueue.java:357)
         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164)
         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:142)
         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:196)
         at java.lang.Thread.run(Thread.java:745)
    5) Thread[id=9509, name=zkCallback-1699-thread-2, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    6) Thread[id=9511, name=zkCallback-1699-thread-4, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    7) Thread[id=9496, name=Connection evictor, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at java.lang.Thread.sleep(Native Method)
         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
         at java.lang.Thread.run(Thread.java:745)
    8) Thread[id=9507, name=Thread-3280, state=WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:502)
         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1276)
    9) Thread[id=9505, name=OverseerCollectionConfigSetProcessor-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.]
         at java.lang.Thread.sleep(Native Method)
         at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:102)
         at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
         at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:345)
         at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:328)
         at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:167)
         at java.lang.Thread.run(Thread.java:745)
   10) Thread[id=9506, name=OverseerHdfsCoreFailoverThread-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
         at java.lang.Thread.sleep(Native Method)
         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
         at java.lang.Thread.run(Thread.java:745)
   11) Thread[id=9497, name=Connection evictor, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at java.lang.Thread.sleep(Native Method)
         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
         at java.lang.Thread.run(Thread.java:745)
   12) Thread[id=9501, name=TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[73EB7917430072DC]-SendThread(127.0.0.1:45238), state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at java.lang.Thread.sleep(Native Method)
         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC]:0)


FAILED: junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionIntegrationTest

Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=9512, name=zkCallback-1699-thread-5, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=9509, name=zkCallback-1699-thread-2, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=9511, name=zkCallback-1699-thread-4, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=9507, name=Thread-3280, state=WAITING, group=TGRP-LeaderElectionIntegrationTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1276) 5) Thread[id=9506, name=OverseerHdfsCoreFailoverThread-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Throwable.fillInStackTrace(Native Method) at java.lang.Throwable.fillInStackTrace(Throwable.java:783) at java.lang.Throwable.(Exception.java:66) at java.lang.InterruptedException.(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=9510, name=zkCallback-1699-thread-3, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=9501, name=TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[73EB7917430072DC]-SendThread(127.0.0.1:45238), state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
    1) Thread[id=9512, name=zkCallback-1699-thread-5, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    2) Thread[id=9509, name=zkCallback-1699-thread-2, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    3) Thread[id=9511, name=zkCallback-1699-thread-4, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    4) Thread[id=9507, name=Thread-3280, state=WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:502)
         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1276)
    5) Thread[id=9506, name=OverseerHdfsCoreFailoverThread-96022267680718851-127.0.0.1:7000_solr-n_0000000000, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
         at java.lang.Throwable.fillInStackTrace(Native Method)
         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
         at java.lang.Throwable.(Exception.java:66)
         at java.lang.InterruptedException.(Native Method)
         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
         at java.lang.Thread.run(Thread.java:745)
    6) Thread[id=9510, name=zkCallback-1699-thread-3, state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at sun.misc.Unsafe.park(Native Method)
         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
    7) Thread[id=9501, name=TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[73EB7917430072DC]-SendThread(127.0.0.1:45238), state=TIMED_WAITING, group=TGRP-LeaderElectionIntegrationTest]
         at java.lang.Thread.sleep(Native Method)
         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC]:0)


FAILED: org.apache.solr.cloud.SyncSliceTest.test

Error Message:
Error from server at http://127.0.0.1:33249/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 503 </title> </head> <body> <h2>HTTP ERROR: 503</h2> <p>Problem accessing /collection1/update. Reason: <pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/> </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:33249/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /collection1/update. Reason:
<pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/>
</body>
[73EB7917430072DC:FBBF46CDEDFC1F24]:0)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
  at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.del(AbstractFullDistribZkTestBase.java:835)
  at org.apache.solr.cloud.SyncSliceTest.test(SyncSliceTest.java:75)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.CollectionTooManyReplicasTest.testAddTooManyReplicas

Error Message:
No registered leader was found after waiting for 10000ms , collection: collection1 slice: shard1

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 10000ms , collection: collection1 slice: shard1
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:FEB90DCF0DE64D6D]:0)
  at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:718)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:427)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:332)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:983)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.index.hdfs.CheckHdfsIndexTest.testBogusTermVectors

Error Message:
No registered leader was found after waiting for 10000ms , collection: collection1 slice: shard1

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 10000ms , collection: collection1 slice: shard1
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:75EFDF772C3F458C]:0)
  at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:718)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:427)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:332)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:983)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.index.hdfs.CheckHdfsIndexTest.testDeletedDocs

Error Message:
No registered leader was found after waiting for 10000ms , collection: collection1 slice: shard1

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 10000ms , collection: collection1 slice: shard1
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:C9601E8914DD2D0B]:0)
  at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:718)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:427)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:332)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:983)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.AsyncMigrateRouteKeyTest.test

Error Message:
Error from server at http://127.0.0.1:38280/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 503 </title> </head> <body> <h2>HTTP ERROR: 503</h2> <p>Problem accessing /collection1/update. Reason: <pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/> </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38280/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /collection1/update. Reason:
<pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/>
</body>
[73EB7917430072DC:FBBF46CDEDFC1F24]:0)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
  at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.del(AbstractFullDistribZkTestBase.java:835)
  at org.apache.solr.cloud.MigrateRouteKeyTest.multipleShardMigrateTest(MigrateRouteKeyTest.java:135)
  at org.apache.solr.cloud.AsyncMigrateRouteKeyTest.test(AsyncMigrateRouteKeyTest.java:44)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.test

Error Message:
Error from server at http://127.0.0.1:40574: Error CREATEing SolrCore 'onenodecollectioncore': Unable to create core [onenodecollectioncore] Caused by: Timed out getting coreNodeName for onenodecollectioncore

Stack Trace:
java.lang.AssertionError: Error from server at http://127.0.0.1:40574: Error CREATEing SolrCore 'onenodecollectioncore': Unable to create core [onenodecollectioncore] Caused by: Timed out getting coreNodeName for onenodecollectioncore
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:FBBF46CDEDFC1F24]:0)
  at org.junit.Assert.fail(Assert.java:93)
  at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:162)
  at org.apache.solr.cloud.BasicDistributedZk2Test.test(BasicDistributedZk2Test.java:71)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:51536/jesq/i/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 503 </title> </head> <body> <h2>HTTP ERROR: 503</h2> <p>Problem accessing /jesq/i/collection1/update. Reason: <pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/> </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51536/jesq/i/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /jesq/i/collection1/update. Reason:
<pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/>
</body>
[73EB7917430072DC:FBBF46CDEDFC1F24]:0)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
  at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.del(AbstractFullDistribZkTestBase.java:835)
  at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:152)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
Error from server at http://127.0.0.1:54974/j/ma/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 503 </title> </head> <body> <h2>HTTP ERROR: 503</h2> <p>Problem accessing /j/ma/collection1/update. Reason: <pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/> </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:54974/j/ma/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /j/ma/collection1/update. Reason:
<pre> {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg=SolrCore is loading,code=503}</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.8.v20160314</a><hr/>
</body>
[73EB7917430072DC:FBBF46CDEDFC1F24]:0)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
  at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
  at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.del(AbstractFullDistribZkTestBase.java:835)
  at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.tryDelete(ChaosMonkeySafeLeaderTest.java:190)
  at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:92)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)


FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:56080

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:56080
  at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:FBBF46CDEDFC1F24]:0)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:617)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
  at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
  at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
  at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:400)
  at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testNoConfigSetExist(CollectionsAPIDistributedZkTest.java:602)
  at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:177)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
  at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
  at java.net.SocketInputStream.socketRead0(Native Method)
  at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
  at java.net.SocketInputStream.read(SocketInputStream.java:170)
  at java.net.SocketInputStream.read(SocketInputStream.java:141)
  at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
  at sun.security.ssl.InputRecord.read(InputRecord.java:503)
  at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
  at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
  at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
  at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)
  at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)
  at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)
  at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
  at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
  at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
  at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
  at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)
  at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
  at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
  at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
  at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
  at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
  at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
  at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)


[...truncated too long message...]

6574-thread-1-processing-n:10.41.0.5:8983_) [n:10.41.0.5:8983_ c:collection1 s:shard1 r:10.41.0.5:8983__collection1 x:collection1] o.a.s.c.CoreContainer Error creating core [collection1]: Timed out getting shard id for core: collection1
    [junit4] 2> org.apache.solr.common.SolrException: Timed out getting shard id for core: collection1
    [junit4] 2> at org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1407)
    [junit4] 2> at org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1362)
    [junit4] 2> at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1459)
    [junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:832)
    [junit4] 2> at org.apache.solr.core.CoreContainer.lambda$load$0(CoreContainer.java:491)
    [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
    [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    [junit4] 2> at java.lang.Thread.run(Thread.java:745)
    [junit4] 2> 6924928 INFO (SUITE-BasicZkTest-seed#[73EB7917430072DC]-worker) [n:10.41.0.5:8983_ ] o.a.s.SolrTestCaseJ4 ####initCore end
    [junit4] 2> 6924933 INFO (TEST-BasicZkTest.testBasic-seed#[73EB7917430072DC]) [n:10.41.0.5:8983_ ] o.a.s.SolrTestCaseJ4 ###Starting testBasic
    [junit4] 2> 6954948 INFO (TEST-BasicZkTest.testBasic-seed#[73EB7917430072DC]) [n:10.41.0.5:8983_ ] o.a.s.SolrTestCaseJ4 ###Ending testBasic
    [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicZkTest -Dtests.method=testBasic -Dtests.seed=73EB7917430072DC -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ar-DZ -Dtests.timezone=Australia/Lindeman -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
    [junit4] ERROR 30.0s J0 | BasicZkTest.testBasic <<<
    [junit4] > Throwable #1: org.apache.solr.common.SolrException: No registered leader was found after waiting for 30000ms , collection: collection1 slice: shard1
    [junit4] > at __randomizedtesting.SeedInfo.seed([73EB7917430072DC:D81164029CDCF4F2]:0)
    [junit4] > at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:718)
    [junit4] > at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:685)
    [junit4] > at org.apache.solr.cloud.BasicZkTest.testBasic(BasicZkTest.java:51)
    [junit4] > at java.lang.Thread.run(Thread.java:745)
    [junit4] 2> 6954949 INFO (SUITE-BasicZkTest-seed#[73EB7917430072DC]-worker) [n:10.41.0.5:8983_ ] o.a.s.SolrTestCaseJ4 ###deleteCore
    [junit4] 2> 6954951 INFO (SUITE-BasicZkTest-seed#[73EB7917430072DC]-worker) [n:10.41.0.5:8983_ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1494742122
    [junit4] 2> 6954951 INFO (SUITE-BasicZkTest-seed#[73EB7917430072DC]-worker) [n:10.41.0.5:8983_ ] o.a.s.c.ZkController Publish node=10.41.0.5:8983_ as DOWN
    [junit4] 2> 6954952 INFO (OverseerStateUpdate-96022285930594307-10.41.0.5:8983_-n_0000000000) [n:10.41.0.5:8983_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
    [junit4] 2> "operation":"downnode",
    [junit4] 2> "node_name":"10.41.0.5:8983_"} current state version: 1
    [junit4] 2> 6954952 INFO (OverseerStateUpdate-96022285930594307-10.41.0.5:8983_-n_0000000000) [n:10.41.0.5:8983_ ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 10.41.0.5:8983_
    [junit4] 2> 6954952 INFO (OverseerStateUpdate-96022285930594307-10.41.0.5:8983_-n_0000000000) [n:10.41.0.5:8983_ ] o.a.s.c.o.NodeMutator Update replica state for 10.41.0.5:8983__collection1:{"core":"collection1","base_url":"http://10.41.0.5:8983","node_name":"10.41.0.5:8983_","state":"down"} to down
    [junit4] 2> 6954953 INFO (SUITE-BasicZkTest-seed#[73EB7917430072DC]-worker) [n:10.41.0.5:8983_ ] o.a.s.c.Overseer Overseer (id=96022285930594307-10.41.0.5:8983_-n_0000000000) closing
    [junit4] 2> 6954953 INFO (OverseerStateUpdate-96022285930594307-10.41.0.5:8983_-n_0000000000) [n:10.41.0.5:8983_ ] o.a.s.c.Overseer Overseer Loop exiting : 10.41.0.5:8983_
    [junit4] 2> 6954954 INFO (zkCallback-16325-thread-2-processing-n:10.41.0.5:8983_) [n:10.41.0.5:8983_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
    [junit4] 2> 6956454 WARN (zkCallback-16325-thread-2-processing-n:10.41.0.5:8983_) [n:10.41.0.5:8983_ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
    [junit4] 2> 6956455 INFO (SUITE-BasicZkTest-seed#[73EB7917430072DC]-worker) [n:10.41.0.5:8983_ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46812 46812
    [junit4] 2> 6956748 INFO (Thread-3009) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46812 46812
    [junit4] 2> 6956749 INFO (SUITE-BasicZkTest-seed#[73EB7917430072DC]-worker) [n:10.41.0.5:8983_ ] o.a.s.SolrTestCaseJ4 ###deleteCore
    [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicZkTest_73EB7917430072DC-001
    [junit4] 2> Jun 06, 2016 3:35:58 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
    [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
    [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1520, maxMBSortInHeap=7.020590743992748, sim=ClassicSimilarity, locale=ar-DZ, timezone=Australia/Lindeman
    [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=115553416,total=500170752
    [junit4] 2> NOTE: All tests run in this JVM: [TestRequestStatusCollectionAPI, TestStressLucene, QueryEqualityTest, QueryElevationComponentTest, ZkNodePropsTest, TestFieldResource, SyncSliceTest, SystemInfoHandlerTest, TestComponentsName, TestLuceneMatchVersion, AnalyticsQueryTest, TestConfigSetsAPIExclusivity, TestManagedSchema, TestLeaderElectionZkExpiry, TestUseDocValuesAsStored, TestClassicSimilarityFactory, TestDistributedSearch, TolerantUpdateProcessorTest, RAMDirectoryFactoryTest, CdcrUpdateLogTest, TestClusterStateMutator, TestRandomDVFaceting, TestStressLiveNodes, TestFastOutputStream, TestFaceting, ReplicationFactorTest, TestAnalyzeInfixSuggestions, TestSchemaNameResource, XsltUpdateRequestHandlerTest, DisMaxRequestHandlerTest, TestPseudoReturnFields, TestOverriddenPrefixQueryForCustomFieldType, TestSolrQueryParserResource, TestDistribIDF, StandardRequestHandlerTest, ReturnFieldsTest, TestMiniSolrCloudClusterSSL, TestPerFieldSimilarityWithDefaultOverride, TestCSVLoader, CoreAdminCreateDiscoverTest, BlockJoinFacetDistribTest, OverseerTaskQueueTest, TestManagedResourceStorage, PeerSyncTest, TestCustomDocTransformer, TestLRUStatsCache, ConcurrentDeleteAndCreateCollectionTest, TestManagedSynonymFilterFactory, UUIDFieldTest, OutputWriterTest, TestBinaryField, SharedFSAutoReplicaFailoverTest, TestDistribDocBasedVersion, SuggestComponentContextFilterQueryTest, TestSQLHandler, TestOmitPositions, RequestLoggingTest, PrimUtilsTest, ActionThrottleTest, TestDynamicFieldCollectionResource, PathHierarchyTokenizerFactoryTest, CloudExitableDirectoryReaderTest, DistributedSuggestComponentTest, TlogReplayBufferedWhileIndexingTest, TestValueSourceCache, HdfsLockFactoryTest, URLClassifyProcessorTest, RequiredFieldsTest, HdfsUnloadDistributedZkTest, ForceLeaderTest, AnalysisAfterCoreReloadTest, PreAnalyzedFieldTest, TestFieldCacheSortRandom, ExternalFileFieldSortTest, TestPhraseSuggestions, BasicDistributedZkTest, DistribJoinFromCollectionTest, TestRebalanceLeaders, SpatialRPTFieldTypeTest, JavabinLoaderTest, TestJsonRequest, CurrencyFieldOpenExchangeTest, TestHighlightDedupGrouping, TestRemoteStreaming, TestReloadDeadlock, DistributedQueryElevationComponentTest, TestDocSet, FileBasedSpellCheckerTest, ConnectionReuseTest, TestExpandComponent, MultiThreadedOCPTest, CollectionTooManyReplicasTest, TestSmileRequest, TestSolrConfigHandler, TestJoin, HdfsSyncSliceTest, TestConfig, DistributedFacetPivotLongTailTest, TestRealTimeGet, HLLSerializationTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, BasicZkTest]
    [junit4] Completed [612/612 (16!)] on J0 in 352.87s, 1 test, 1 error <<< FAILURES!

[...truncated 20 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:531: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1427: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:984: There were test failures: 612 suites (10 ignored), 2560 tests, 2 suite-level errors, 16 errors, 2 failures, 1251 ignored (67 assumptions) [seed: 73EB7917430072DC]

Total time: 145 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

Search Discussions

  • Apache Jenkins Server at Jun 6, 2016 at 10:01 pm
    Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1197/

    1 tests failed.
    FAILED: org.apache.solr.TestDistributedSearch.test

    Error Message:
    Expected to find shardAddress in the up shard info

    Stack Trace:
    java.lang.AssertionError: Expected to find shardAddress in the up shard info
      at __randomizedtesting.SeedInfo.seed([A5D189AD312CE909:2D85B6779FD084F1]:0)
      at org.junit.Assert.fail(Assert.java:93)
      at org.junit.Assert.assertTrue(Assert.java:43)
      at org.apache.solr.TestDistributedSearch.comparePartialResponses(TestDistributedSearch.java:1172)
      at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1113)
      at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:973)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:498)
      at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
      at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
      at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
      at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
      at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1011)
      at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
      at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
      at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
      at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
      at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
      at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
      at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
      at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
      at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
      at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
      at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
      at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
      at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
      at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
      at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
      at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
      at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
      at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
      at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
      at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
      at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
      at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
      at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
      at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
      at java.lang.Thread.run(Thread.java:745)




    Build Log:
    [...truncated 10885 lines...]
        [junit4] Suite: org.apache.solr.TestDistributedSearch
        [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/init-core-data-001
        [junit4] 2> 384349 INFO (SUITE-TestDistributedSearch-seed#[A5D189AD312CE909]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-9061)
        [junit4] 2> 384349 INFO (SUITE-TestDistributedSearch-seed#[A5D189AD312CE909]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /a_avk/
        [junit4] 2> 384484 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1
        [junit4] 2> 384489 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
        [junit4] 2> 384574 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c4887d2{/a_avk,null,AVAILABLE}
        [junit4] 2> 384575 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.ServerConnector Started ServerConnector@23661dd{HTTP/1.1,[http/1.1]}{127.0.0.1:56865}
        [junit4] 2> 384575 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.Server Started @388237ms
        [junit4] 2> 384575 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/a_avk, hostPort=56865, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores}
        [junit4] 2> 384575 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
        [junit4] 2> 384575 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control'
        [junit4] 2> 384575 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
        [junit4] 2> 384575 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
        [junit4] 2> 384576 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/solr.xml
        [junit4] 2> 384580 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores
        [junit4] 2> 384580 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer New CoreContainer 1564279694
        [junit4] 2> 384580 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control]
        [junit4] 2> 384580 WARN (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/lib
        [junit4] 2> 384583 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
        [junit4] 2> 384594 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
        [junit4] 2> 384596 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
        [junit4] 2> 384596 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
        [junit4] 2> 384597 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
        [junit4] 2> 384597 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
        [junit4] 2> 384597 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores
        [junit4] 2> 384598 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/, configSet=collection1}
        [junit4] 2> 384598 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1
        [junit4] 2> 384598 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
        [junit4] 2> 384610 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1'
        [junit4] 2> 384799 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
        [junit4] 2> 384799 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
        [junit4] 2> 384799 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
        [junit4] 2> 384799 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/lib/README' to classloader
        [junit4] 2> 384613 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0
        [junit4] 2> 384801 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
        [junit4] 2> 384813 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
        [junit4] 2> 384818 WARN (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
        [junit4] 2> 384819 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
        [junit4] 2> 384832 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
        [junit4] 2> 384835 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
        [junit4] 2> 384928 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
        [junit4] 2> 384932 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.IndexSchema default search field in schema is text
        [junit4] 2> 384933 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
        [junit4] 2> 384937 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
        [junit4] 2> 384938 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
        [junit4] 2> 384939 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
        [junit4] 2> 384939 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
        [junit4] 2> 384940 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1'
        [junit4] 2> 384940 INFO (coreLoadExecutor-1535-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1
        [junit4] 2> 384940 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
        [junit4] 2> 384940 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1/data/]
        [junit4] 2> 384940 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4030bfde
        [junit4] 2> 384941 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1/data
        [junit4] 2> 384941 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1/data/index/
        [junit4] 2> 384941 WARN (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1/data/index' doesn't exist. Creating new index...
        [junit4] 2> 384941 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1/data/index
        [junit4] 2> 384941 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.40755474490328614]
        [junit4] 2> 384942 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@334d6b23 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34a6d5fd),segFN=segments_1,generation=1}
        [junit4] 2> 384942 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
        [junit4] 2> 384963 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
        [junit4] 2> 384964 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
        [junit4] 2> 384965 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 384966 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 384966 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 384969 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 384970 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
        [junit4] 2> 384971 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,/export,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/sql,/graph,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
        [junit4] 2> 384971 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
        [junit4] 2> 384974 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1/data/
        [junit4] 2> 384974 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/control/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
        [junit4] 2> 384986 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
        [junit4] 2> 384993 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
        [junit4] 2> 384993 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
        [junit4] 2> 384993 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
        [junit4] 2> 384994 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=44.6240234375, floorSegmentMB=2.16015625, forceMergeDeletesPctAllowed=8.971805981323635, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21777016460086465
        [junit4] 2> 384999 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@334d6b23 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34a6d5fd),segFN=segments_1,generation=1}
        [junit4] 2> 385000 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
        [junit4] 2> 385000 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4802b568[collection1] main]
        [junit4] 2> 385000 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
        [junit4] 2> 385000 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
        [junit4] 2> 385000 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
        [junit4] 2> 385000 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
        [junit4] 2> 385008 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
        [junit4] 2> 385036 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
        [junit4] 2> 385036 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
        [junit4] 2> 385037 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
        [junit4] 2> 385037 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
        [junit4] 2> 385037 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
        [junit4] 2> 385037 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
        [junit4] 2> 385037 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
        [junit4] 2> 385037 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
        [junit4] 2> 385037 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
        [junit4] 2> 385037 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1536424031446630400
        [junit4] 2> 385037 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
        [junit4] 2> 385037 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
        [junit4] 2> 385037 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
        [junit4] 2> 385038 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
        [junit4] 2> 385038 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4802b568[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
        [junit4] 2> 385039 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1536424031446630400
        [junit4] 2> 385039 INFO (coreLoadExecutor-1535-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
        [junit4] 2> 385468 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1
        [junit4] 2> 385469 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
        [junit4] 2> 385479 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72c2f9e2{/a_avk,null,AVAILABLE}
        [junit4] 2> 385479 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.ServerConnector Started ServerConnector@12843554{HTTP/1.1,[http/1.1]}{127.0.0.1:46252}
        [junit4] 2> 385479 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.Server Started @389142ms
        [junit4] 2> 385480 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/a_avk, hostPort=46252, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores}
        [junit4] 2> 385480 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
        [junit4] 2> 385480 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0'
        [junit4] 2> 385480 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
        [junit4] 2> 385480 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
        [junit4] 2> 385489 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/solr.xml
        [junit4] 2> 385492 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores
        [junit4] 2> 385492 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer New CoreContainer 710224343
        [junit4] 2> 385492 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0]
        [junit4] 2> 385492 WARN (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/lib
        [junit4] 2> 385493 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
        [junit4] 2> 385495 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
        [junit4] 2> 385498 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
        [junit4] 2> 385498 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
        [junit4] 2> 385499 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
        [junit4] 2> 385499 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
        [junit4] 2> 385499 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores
        [junit4] 2> 385499 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/, configSet=collection1}
        [junit4] 2> 385499 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1
        [junit4] 2> 385499 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
        [junit4] 2> 385501 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1'
        [junit4] 2> 385515 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
        [junit4] 2> 385515 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
        [junit4] 2> 385515 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
        [junit4] 2> 385515 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/lib/README' to classloader
        [junit4] 2> 385517 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0
        [junit4] 2> 385517 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
        [junit4] 2> 385550 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
        [junit4] 2> 385555 WARN (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
        [junit4] 2> 385556 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
        [junit4] 2> 385586 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
        [junit4] 2> 385592 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
        [junit4] 2> 385719 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
        [junit4] 2> 385724 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.IndexSchema default search field in schema is text
        [junit4] 2> 385724 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
        [junit4] 2> 385727 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
        [junit4] 2> 385728 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
        [junit4] 2> 385728 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
        [junit4] 2> 385729 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
        [junit4] 2> 385739 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1'
        [junit4] 2> 385739 INFO (coreLoadExecutor-1546-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1
        [junit4] 2> 385739 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
        [junit4] 2> 385739 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1/data/]
        [junit4] 2> 385739 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4030bfde
        [junit4] 2> 385740 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1/data
        [junit4] 2> 385740 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1/data/index/
        [junit4] 2> 385740 WARN (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1/data/index' doesn't exist. Creating new index...
        [junit4] 2> 385740 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1/data/index
        [junit4] 2> 385740 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.40755474490328614]
        [junit4] 2> 385743 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d0da6e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f73b150),segFN=segments_1,generation=1}
        [junit4] 2> 385743 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
        [junit4] 2> 385758 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1/data/
        [junit4] 2> 385758 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard0/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
        [junit4] 2> 385760 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
        [junit4] 2> 385761 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
        [junit4] 2> 385762 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 385763 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 385763 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 385764 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
        [junit4] 2> 385767 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
        [junit4] 2> 385768 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,/export,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/sql,/graph,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
        [junit4] 2> 385768 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
        [junit4] 2> 385778 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
        [junit4] 2> 385778 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
        [junit4] 2> 385778 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
        [junit4] 2> 385778 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
        [junit4] 2> 385779 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=44.6240234375, floorSegmentMB=2.16015625, forceMergeDeletesPctAllowed=8.971805981323635, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21777016460086465
        [junit4] 2> 385779 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d0da6e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f73b150),segFN=segments_1,generation=1}
        [junit4] 2> 385779 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
        [junit4] 2> 385780 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17a7e77d[collection1] main]
        [junit4] 2> 385780 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
        [junit4] 2> 385780 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
        [junit4] 2> 385780 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
        [junit4] 2> 385780 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
        [junit4] 2> 385786 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
        [junit4] 2> 385804 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
        [junit4] 2> 385804 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
        [junit4] 2> 385804 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
        [junit4] 2> 385804 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
        [junit4] 2> 385804 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
        [junit4] 2> 385805 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
        [junit4] 2> 385805 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
        [junit4] 2> 385805 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
        [junit4] 2> 385805 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
        [junit4] 2> 385805 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
        [junit4] 2> 385805 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1536424032251936768
        [junit4] 2> 385805 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
        [junit4] 2> 385805 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
        [junit4] 2> 385805 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
        [junit4] 2> 385806 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@17a7e77d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
        [junit4] 2> 385806 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1536424032251936768
        [junit4] 2> 385807 INFO (coreLoadExecutor-1546-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
        [junit4] 2> 386026 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
        [junit4] 2> 386054 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1536424032504643584)} 0 7
        [junit4] 2> 386081 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1536424032539246592)} 0 2
        [junit4] 2> 386084 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[1 (1536424032542392320)]} 0 1
        [junit4] 2> 386093 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[1 (1536424032548683776)]} 0 4
        [junit4] 2> 386094 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[2 (1536424032554975232)]} 0 0
        [junit4] 2> 386095 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[2 (1536424032556023808)]} 0 0
        [junit4] 2> 386096 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[3 (1536424032557072384)]} 0 0
        [junit4] 2> 386100 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[3 (1536424032561266688)]} 0 0
        [junit4] 2> 386101 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[4 (1536424032562315264)]} 0 0
        [junit4] 2> 386102 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[4 (1536424032563363840)]} 0 0
        [junit4] 2> 386103 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[5 (1536424032564412416)]} 0 0
        [junit4] 2> 386104 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[5 (1536424032564412416)]} 0 0
        [junit4] 2> 386105 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[6 (1536424032565460992)]} 0 0
        [junit4] 2> 386105 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[6 (1536424032566509568)]} 0 0
        [junit4] 2> 386106 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[7 (1536424032567558144)]} 0 0
        [junit4] 2> 386107 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[7 (1536424032568606720)]} 0 0
        [junit4] 2> 386108 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[8 (1536424032568606720)]} 0 0
        [junit4] 2> 386280 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[8 (1536424032750010368)]} 0 0
        [junit4] 2> 386281 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[9 (1536424032751058944)]} 0 0
        [junit4] 2> 386282 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[9 (1536424032752107520)]} 0 0
        [junit4] 2> 386282 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
        [junit4] 2> 386311 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@334d6b23 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34a6d5fd),segFN=segments_1,generation=1}
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@334d6b23 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34a6d5fd),segFN=segments_2,generation=2}
        [junit4] 2> 386312 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
        [junit4] 2> 386319 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@58b8bff3[collection1] main]
        [junit4] 2> 386319 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
        [junit4] 2> 386320 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@58b8bff3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.0.0):C9)))}
        [junit4] 2> 386320 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 37
        [junit4] 2> 386321 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
        [junit4] 2> 386341 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d0da6e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f73b150),segFN=segments_1,generation=1}
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d0da6e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f73b150),segFN=segments_2,generation=2}
        [junit4] 2> 386341 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
        [junit4] 2> 386343 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@796b2b6a[collection1] main]
        [junit4] 2> 386343 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
        [junit4] 2> 386344 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@796b2b6a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.0.0):C9)))}
        [junit4] 2> 386344 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 23
        [junit4] 2> 386347 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[10 (1536424032818167808)]} 0 2
        [junit4] 2> 386349 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[10 (1536424032821313536)]} 0 1
        [junit4] 2> 386350 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[11 (1536424032823410688)]} 0
        [junit4] 2> 386351 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[11 (1536424032824459264)]} 0
        [junit4] 2> 386358 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[12 (1536424032831799296)]} 0
        [junit4] 2> 386359 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[12 (1536424032832847872)]} 0
        [junit4] 2> 386360 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[13 (1536424032832847872)]} 0
        [junit4] 2> 386360 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[13 (1536424032833896448)]} 0
        [junit4] 2> 386362 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[1001 (1536424032834945024)]} 0 0
        [junit4] 2> 386363 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[1001 (1536424032837042176)]} 0 0
        [junit4] 2> 386364 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[14 (1536424032838090752)]} 0
        [junit4] 2> 386365 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[14 (1536424032839139328)]} 0
        [junit4] 2> 386366 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[15 (1536424032839139328)]} 0
        [junit4] 2> 386366 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[15 (1536424032840187904)]} 0
        [junit4] 2> 386367 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[16 (1536424032841236480)]} 0
        [junit4] 2> 386368 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[16 (1536424032842285056)]} 0
        [junit4] 2> 386369 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[17 (1536424032843333632)]} 0
        [junit4] 2> 386370 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[17 (1536424032844382208)]} 0
        [junit4] 2> 386371 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[100 (1536424032844382208)]} 0 0
        [junit4] 2> 386371 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[100 (1536424032845430784)]} 0 0
        [junit4] 2> 386372 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[101 (1536424032846479360)]} 0 0
        [junit4] 2> 386373 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[101 (1536424032846479360)]} 0 0
        [junit4] 2> 386373 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[102 (1536424032847527936)]} 0 0
        [junit4] 2> 386374 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[102 (1536424032848576512)]} 0 0
        [junit4] 2> 386374 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[103 (1536424032848576512)]} 0 0
        [junit4] 2> 386375 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[103 (1536424032849625088)]} 0 0
        [junit4] 2> 386376 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[104 (1536424032850673664)]} 0 0
        [junit4] 2> 386376 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[104 (1536424032850673664)]} 0 0
        [junit4] 2> 386377 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[105 (1536424032851722240)]} 0 0
        [junit4] 2> 386378 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[105 (1536424032852770816)]} 0 0
        [junit4] 2> 386379 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[106 (1536424032853819392)]} 0 0
        [junit4] 2> 386380 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[106 (1536424032854867968)]} 0 0
        [junit4] 2> 386381 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[107 (1536424032855916544)]} 0 0
        [junit4] 2> 386381 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[107 (1536424032855916544)]} 0 0
        [junit4] 2> 386382 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[108 (1536424032856965120)]} 0 0
        [junit4] 2> 386383 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[108 (1536424032856965120)]} 0 0
        [junit4] 2> 386383 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[109 (1536424032858013696)]} 0 0
        [junit4] 2> 386384 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[109 (1536424032859062272)]} 0 0
        [junit4] 2> 386385 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[110 (1536424032859062272)]} 0 0
        [junit4] 2> 386385 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[110 (1536424032860110848)]} 0 0
        [junit4] 2> 386386 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[111 (1536424032861159424)]} 0 0
        [junit4] 2> 386387 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[111 (1536424032861159424)]} 0 0
        [junit4] 2> 386387 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[112 (1536424032862208000)]} 0 0
        [junit4] 2> 386388 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[112 (1536424032863256576)]} 0 0
        [junit4] 2> 386389 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[113 (1536424032863256576)]} 0 0
        [junit4] 2> 386389 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[113 (1536424032864305152)]} 0 0
        [junit4] 2> 386390 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[114 (1536424032865353728)]} 0 0
        [junit4] 2> 386390 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[114 (1536424032865353728)]} 0 0
        [junit4] 2> 386391 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[115 (1536424032866402304)]} 0 0
        [junit4] 2> 386392 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[115 (1536424032866402304)]} 0 0
        [junit4] 2> 386392 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[116 (1536424032867450880)]} 0 0
        [junit4] 2> 386393 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[116 (1536424032868499456)]} 0 0
        [junit4] 2> 386394 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[117 (1536424032868499456)]} 0 0
        [junit4] 2> 386394 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[117 (1536424032869548032)]} 0 0
        [junit4] 2> 386395 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[118 (1536424032870596608)]} 0 0
        [junit4] 2> 386395 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[118 (1536424032870596608)]} 0 0
        [junit4] 2> 386398 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[119 (1536424032873742336)]} 0 0
        [junit4] 2> 386410 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[119 (1536424032886325248)]} 0 0
        [junit4] 2> 386411 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[120 (1536424032887373824)]} 0 0
        [junit4] 2> 386412 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[120 (1536424032887373824)]} 0 0
        [junit4] 2> 386412 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[121 (1536424032888422400)]} 0 0
        [junit4] 2> 386421 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[121 (1536424032896811008)]} 0 0
        [junit4] 2> 386421 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[122 (1536424032897859584)]} 0 0
        [junit4] 2> 386422 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[122 (1536424032898908160)]} 0 0
        [junit4] 2> 386423 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[123 (1536424032898908160)]} 0 0
        [junit4] 2> 386424 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[123 (1536424032899956736)]} 0 0
        [junit4] 2> 386424 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[124 (1536424032901005312)]} 0 0
        [junit4] 2> 386425 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[124 (1536424032902053888)]} 0 0
        [junit4] 2> 386426 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[125 (1536424032902053888)]} 0 0
        [junit4] 2> 386426 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[125 (1536424032903102464)]} 0 0
        [junit4] 2> 386427 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[126 (1536424032904151040)]} 0 0
        [junit4] 2> 386427 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[126 (1536424032904151040)]} 0 0
        [junit4] 2> 386428 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[127 (1536424032905199616)]} 0 0
        [junit4] 2> 386428 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[127 (1536424032905199616)]} 0 0
        [junit4] 2> 386429 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[128 (1536424032906248192)]} 0 0
        [junit4] 2> 386430 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[128 (1536424032906248192)]} 0 0
        [junit4] 2> 386430 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[129 (1536424032907296768)]} 0 0
        [junit4] 2> 386431 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[129 (1536424032908345344)]} 0 0
        [junit4] 2> 386432 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[130 (1536424032909393920)]} 0 0
        [junit4] 2> 386433 INFO (qtp1045521447-3058) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[130 (1536424032910442496)]} 0 0
        [junit4] 2> 386434 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[131 (1536424032911491072)]} 0 0
        [junit4] 2> 386434 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[131 (1536424032911491072)]} 0 0
        [junit4] 2> 386435 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[132 (1536424032912539648)]} 0 0
        [junit4] 2> 386436 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[132 (1536424032912539648)]} 0 0
        [junit4] 2> 386436 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[133 (1536424032913588224)]} 0 0
        [junit4] 2> 386437 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[133 (1536424032914636800)]} 0 0
        [junit4] 2> 386437 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[134 (1536424032914636800)]} 0 0
        [junit4] 2> 386438 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[134 (1536424032915685376)]} 0 0
        [junit4] 2> 386439 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[135 (1536424032915685376)]} 0 0
        [junit4] 2> 386439 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[135 (1536424032916733952)]} 0 0
        [junit4] 2> 386440 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[136 (1536424032917782528)]} 0 0
        [junit4] 2> 386441 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[136 (1536424032917782528)]} 0 0
        [junit4] 2> 386441 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[137 (1536424032918831104)]} 0 0
        [junit4] 2> 386442 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[137 (1536424032919879680)]} 0 0
        [junit4] 2> 386442 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[138 (1536424032919879680)]} 0 0
        [junit4] 2> 386443 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[138 (1536424032920928256)]} 0 0
        [junit4] 2> 386444 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[139 (1536424032921976832)]} 0 0
        [junit4] 2> 386444 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[139 (1536424032921976832)]} 0 0
        [junit4] 2> 386445 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[140 (1536424032923025408)]} 0 0
        [junit4] 2> 386445 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[140 (1536424032923025408)]} 0 0
        [junit4] 2> 386446 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[141 (1536424032924073984)]} 0 0
        [junit4] 2> 386447 INFO (qtp1045521447-3056) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[141 (1536424032924073984)]} 0 0
        [junit4] 2> 386448 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[142 (1536424032926171136)]} 0 0
        [junit4] 2> 386458 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[142 (1536424032936656896)]} 0 0
        [junit4] 2> 386459 INFO (qtp1735073621-3037) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[143 (1536424032937705472)]} 0 0
        [junit4] 2> 386460 INFO (qtp1045521447-3059) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[143 (1536424032937705472)]} 0 0
        [junit4] 2> 386460 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[144 (1536424032938754048)]} 0 0
        [junit4] 2> 386461 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[144 (1536424032939802624)]} 0 0
        [junit4] 2> 386461 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[145 (1536424032939802624)]} 0 0
        [junit4] 2> 386462 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[145 (1536424032940851200)]} 0 0
        [junit4] 2> 386463 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[146 (1536424032940851200)]} 0 0
        [junit4] 2> 386463 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[146 (1536424032941899776)]} 0 0
        [junit4] 2> 386464 INFO (qtp1735073621-3040) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[147 (1536424032942948352)]} 0 0
        [junit4] 2> 386464 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[147 (1536424032942948352)]} 0 0
        [junit4] 2> 386465 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[148 (1536424032943996928)]} 0 0
        [junit4] 2> 386466 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[148 (1536424032943996928)]} 0 0
        [junit4] 2> 386466 INFO (qtp1735073621-3041) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[149 (1536424032945045504)]} 0 0
        [junit4] 2> 386467 INFO (qtp1045521447-3053) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={wt=javabin&version=2}{add=[149 (1536424032946094080)]} 0 0
        [junit4] 2> 386467 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
        [junit4] 2> 386526 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@334d6b23 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34a6d5fd),segFN=segments_2,generation=2}
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@334d6b23 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34a6d5fd),segFN=segments_3,generation=3}
        [junit4] 2> 386526 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 3
        [junit4] 2> 386527 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7a7c539[collection1] main]
        [junit4] 2> 386527 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
        [junit4] 2> 386527 INFO (searcherExecutor-1536-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7a7c539[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.0.0):C9) Uninverting(_1(7.0.0):C59)))}
        [junit4] 2> 386528 INFO (qtp1735073621-3034) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 60
        [junit4] 2> 386530 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
        [junit4] 2> 386617 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d0da6e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f73b150),segFN=segments_2,generation=2}
        [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d0da6e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f73b150),segFN=segments_3,generation=3}
        [junit4] 2> 386617 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 3
        [junit4] 2> 386618 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@244deaee[collection1] main]
        [junit4] 2> 386619 INFO (searcherExecutor-1547-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@244deaee[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.0.0):C9) Uninverting(_1(7.0.0):C59)))}
        [junit4] 2> 386619 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
        [junit4] 2> 386619 INFO (qtp1045521447-3057) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/a_avk path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 89
        [junit4] 2> 386626 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.h.RequestHandlerBase Ignoring exception matching parameter cannot be negative
        [junit4] 2> 386626 INFO (qtp1735073621-3038) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/a_avk path=/select params={q=*&distrib=false&start=-1&wt=javabin&version=2} status=400 QTime=
        [junit4] 2> 386630 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.h.RequestHandlerBase Ignoring exception matching parameter cannot be negative
        [junit4] 2> 386630 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/a_avk path=/select params={q=*&distrib=false&start=0&rows=-1&wt=javabin&version=2} status=400 QTime=0
        [junit4] 2> 386638 INFO (qtp1735073621-3039) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/a_avk path=/select params={q=*:*&distrib=false&sort=n_ti1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
        [junit4] 2> 387040 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/a_avk path=/select params={distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_ti1+desc&shard.url=[ff01::213]:33332/a_avk|http://127.0.0.1:46252/a_avk/collection1&rows=10&version=2&q=*:*&NOW=1465248139755&isShard=true&wt=javabin} hits=68 status=0 QTime=0
        [junit4] 2> 387042 INFO (qtp1045521447-3060) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/a_avk path=/select params={q=*:*&distrib=false&shards.purpose=64&NOW=1465248139755&ids=11,1,16,115,117,7,139,8,108,109&isShard=true&shard.url=[ff01::213]:3333

    [...truncated too long message...]

    =0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=6708,transaction_logs_total_number=3}
        [junit4] 2> 436932 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
        [junit4] 2> 436932 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
        [junit4] 2> 436932 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
        [junit4] 2> 436933 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
        [junit4] 2> 436963 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
        [junit4] 2> 436963 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard1/cores/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard1/cores/collection1/data;done=false>>]
        [junit4] 2> 436964 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
        [junit4] 2> 436964 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard1/cores/collection1/data
        [junit4] 2> 436964 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard1/cores/collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard1/cores/collection1/data/index;done=false>>]
        [junit4] 2> 436964 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
        [junit4] 2> 436964 INFO (coreCloseExecutor-1593-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001/tempDir-001/shard1/cores/collection1/data/index
        [junit4] 2> 436969 INFO (TEST-TestDistributedSearch.test-seed#[A5D189AD312CE909]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2d78f788{/a_avk,null,UNAVAILABLE}
        [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDistributedSearch -Dtests.method=test -Dtests.seed=A5D189AD312CE909 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-EC -Dtests.timezone=Etc/GMT-9 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
        [junit4] FAILURE 52.6s J0 | TestDistributedSearch.test <<<
        [junit4] > Throwable #1: java.lang.AssertionError: Expected to find shardAddress in the up shard info
        [junit4] > at __randomizedtesting.SeedInfo.seed([A5D189AD312CE909:2D85B6779FD084F1]:0)
        [junit4] > at org.apache.solr.TestDistributedSearch.comparePartialResponses(TestDistributedSearch.java:1172)
        [junit4] > at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1113)
        [junit4] > at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:973)
        [junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1011)
        [junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
        [junit4] > at java.lang.Thread.run(Thread.java:745)
        [junit4] 2> 436972 INFO (SUITE-TestDistributedSearch-seed#[A5D189AD312CE909]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
        [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_A5D189AD312CE909-001
        [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {other_tl1=PostingsFormat(name=Memory doPackFST= false), range_facet_l_dv=FST50, SubjectTerms_mfacet=PostingsFormat(name=Memory doPackFST= false), n_l1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_n_tdt=PostingsFormat(name=SimpleText), multiDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), intDefault=PostingsFormat(name=Memory doPackFST= false), n_td1=PostingsFormat(name=Memory doPackFST= false), n_d1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), n_f1=PostingsFormat(name=Memory doPackFST= false), range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), n_tl1=PostingsFormat(name=Memory doPackFST= false), oddField_s=FST50, n_tf1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), lowerfilt1and2=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), lowerfilt=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=FST50, text=PostingsFormat(name=SimpleText), timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), severity=PostingsFormat(name=SimpleText), foo_sev_enum=PostingsFormat(name=SimpleText), n_dt1=PostingsFormat(name=Memory doPackFST= false), a_i1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), b_n_tdt=PostingsFormat(name=Memory doPackFST= false), n_ti1=FST50, rnd_b=FST50, _version_=PostingsFormat(name=Memory doPackFST= false), foo_b=PostingsFormat(name=SimpleText), n_tdt1=PostingsFormat(name=Memory doPackFST= false), foo_d=FST50, range_facet_i_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), foo_f=PostingsFormat(name=SimpleText)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), foo_sev_enum=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=1949, maxMBSortInHeap=6.2931785721181, sim=ClassicSimilarity, locale=es-EC, timezone=Etc/GMT-9
        [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=334151472,total=404226048
        [junit4] 2> NOTE: All tests run in this JVM: [TestDynamicFieldCollectionResource, JavabinLoaderTest, AnalysisAfterCoreReloadTest, BitVectorTest, TestRemoteStreaming, CloneFieldUpdateProcessorFactoryTest, CdcrVersionReplicationTest, TestBinaryField, CacheHeaderTest, ForceLeaderTest, SolrCoreTest, DeleteLastCustomShardedReplicaTest, ReplicationFactorTest, TestOrdValues, QueryEqualityTest, TestJsonRequest, TestDistribDocBasedVersion, BlobRepositoryCloudTest, CopyFieldTest, ConcurrentDeleteAndCreateCollectionTest, TestLegacyFieldCache, SpatialRPTFieldTypeTest, ZkNodePropsTest, URLClassifyProcessorTest, HdfsChaosMonkeySafeLeaderTest, CursorPagingTest, TestExceedMaxTermLength, TestRealTimeGet, TestNRTOpen, TestFieldCacheSortRandom, OutputWriterTest, TestAnalyzedSuggestions, DistributedSpellCheckComponentTest, GraphQueryTest, SuggestComponentContextFilterQueryTest, CoreAdminCreateDiscoverTest, QueryElevationComponentTest, TestSortingResponseWriter, TestReplicationHandlerBackup, TestCloudBackupRestore, DateFieldTest, TestClusterStateMutator, TestDistribIDF, DateRangeFieldTest, TestArbitraryIndexDir, TestSizeLimitedDistributedMap, BlockDirectoryTest, TestMaxScoreQueryParser, SmileWriterTest, TestUninvertingReader, TestStressLucene, FileBasedSpellCheckerTest, CreateCollectionCleanupTest, TestDistributedSearch]
        [junit4] Completed [117/612 (1!)] on J0 in 52.68s, 1 test, 1 failure <<< FAILURES!

    [...truncated 1615 lines...]
    BUILD FAILED
    /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
    /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
    /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
    /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
    /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:531: The following error occurred while executing this line:
    /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1427: The following error occurred while executing this line:
    /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:984: There were test failures: 612 suites (10 ignored), 2560 tests, 1 failure, 87 ignored (72 assumptions) [seed: A5D189AD312CE909]

    Total time: 71 minutes 26 seconds
    Build step 'Invoke Ant' marked build as failure
    Archiving artifacts
    Recording test results
    Email was triggered for: Failure - Any
    Sending email for trigger: Failure - Any

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categorieslucene
postedJun 6, '16 at 3:39a
activeJun 6, '16 at 10:01p
posts2
users1
websitelucene.apache.org

1 user in discussion

Apache Jenkins Server: 2 posts

People

Translate

site design / logo © 2021 Grokbase