Dear all,
I found "Connection refused" error message in main.log of Master tenant while I did delete tenant and created tenant.
Tail of main.log:
[2016-04-02 11:27:46,559] [SID=D0AB7705194016FFD1905A0AF779014C3FFEE3BBEC9A.Pas_Instance] [CustId=1] [IP=10.101.7.16] Selected for installation: [Rollbase]
[2016-04-02 11:27:46,663] [SID=D0AB7705194016FFD1905A0AF779014C3FFEE3BBEC9A.Pas_Instance] [CustId=1] [IP=10.101.7.16] Customer creation is now in progress.
[2016-04-02 11:27:49,984] [SID=D0AB7705194016FFD1905A0AF779014C3FFEE3BBEC9A.Pas_Instance] [CustId=1] [IP=10.101.7.16] ===> Error in thread catalina-exec-1825 at 04/02/2016 11:27 AM
[2016-04-02 11:27:49,984] java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:378)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:473)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:203)
at sun.net.www.http.HttpClient.New(HttpClient.java:290)
at sun.net.www.http.HttpClient.New(HttpClient.java:306)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:995)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:931)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:849)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1090)
at p20.a617.sendRequestWithToken(a617.java:120)
at p21.a678.getRuntimeStatus(a678.java:99)
at com.rb.core.ui.web.field.RuntimeStatus.appendRowDataJSON(RuntimeStatus.java:112)
at com.rb.core.ui.web.field.RuntimeStatus.appendViewJSON(RuntimeStatus.java:161)
at com.rb.core.ui.web.cell.FieldWrapper.appendViewJSON(FieldWrapper.java:447)
at com.rb.core.ui.web.cell.FieldWrapper.appendJSON(FieldWrapper.java:387)
at com.rb.core.ui.web.PageSection.appendJSONAllCellsData(PageSection.java:525)
at com.rb.core.ui.web.PageSection.appendJSONInternal(PageSection.java:489)
at com.rb.core.ui.web.PageSection.appendJSON(PageSection.java:434)
at com.rb.core.ui.web.WebPage.getRuntimeJSONForNonEmptyPage(WebPage.java:2318)
at com.rb.core.ui.web.WebPage.appendPageDataJSON(WebPage.java:1055)
at com.rb.core.ui.web.WebPage.appendPageContentJSON(WebPage.java:909)
at com.rb.core.logics.servlet.AjaxServlet.doGet(AjaxServlet.java:686)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.util.web.NoCacheFilter.doFilter(NoCacheFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.core.logics.filter.SessionTimestampFilter.doFilter(SessionTimestampFilter.java:56)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.util.web.RequestLoggingFilter.doFilter(RequestLoggingFilter.java:36)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at org.apache.catalina.valves.StuckThreadDetectionValve.invoke(StuckThreadDetectionValve.java:193)
at org.apache.catalina.valves.CrawlerSessionManagerValve.invoke(CrawlerSessionManagerValve.java:180)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:314)
at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:305)
at org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:83)
at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:305)
at org.apache.catalina.valves.RemoteHostValve.invoke(RemoteHostValve.java:83)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.ha.session.JvmRouteBinderValve.invoke(JvmRouteBinderValve.java:219)
at org.apache.catalina.ha.tcp.ReplicationValve.invoke(ReplicationValve.java:335)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:200)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
[2016-04-02 11:27:56,556] [CustId=1] ==>> Database creation completed at 04/02/2016 11:27 AM
[2016-04-02 11:28:01,803] [SID=D0AB7705194016FFD1905A0AF779014C3FFEE3BBEC9A.Pas_Instance] [CustId=1] [IP=10.101.7.16] ===> Error in thread catalina-exec-1825 at 04/02/2016 11:28 AM
[2016-04-02 11:28:01,803] java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:378)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:473)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:203)
at sun.net.www.http.HttpClient.New(HttpClient.java:290)
at sun.net.www.http.HttpClient.New(HttpClient.java:306)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:995)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:931)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:849)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1090)
at p20.a617.sendRequestWithToken(a617.java:120)
at p21.a678.getRuntimeStatus(a678.java:99)
at com.rb.core.ui.web.field.RuntimeStatus.appendRowDataJSON(RuntimeStatus.java:112)
at com.rb.core.ui.web.field.RuntimeStatus.appendViewJSON(RuntimeStatus.java:161)
at com.rb.core.ui.web.cell.FieldWrapper.appendViewJSON(FieldWrapper.java:447)
at com.rb.core.ui.web.cell.FieldWrapper.appendJSON(FieldWrapper.java:387)
at com.rb.core.ui.web.PageSection.appendJSONAllCellsData(PageSection.java:525)
at com.rb.core.ui.web.PageSection.appendJSONInternal(PageSection.java:489)
at com.rb.core.ui.web.PageSection.appendJSON(PageSection.java:434)
at com.rb.core.ui.web.WebPage.getTabRuntimeJSON(WebPage.java:1069)
at com.rb.core.logics.servlet.AjaxServlet.doGet(AjaxServlet.java:366)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.util.web.NoCacheFilter.doFilter(NoCacheFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.core.logics.filter.SessionTimestampFilter.doFilter(SessionTimestampFilter.java:56)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.util.web.RequestLoggingFilter.doFilter(RequestLoggingFilter.java:36)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at org.apache.catalina.valves.StuckThreadDetectionValve.invoke(StuckThreadDetectionValve.java:193)
at org.apache.catalina.valves.CrawlerSessionManagerValve.invoke(CrawlerSessionManagerValve.java:180)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:314)
at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:305)
at org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:83)
at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:305)
at org.apache.catalina.valves.RemoteHostValve.invoke(RemoteHostValve.java:83)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.ha.session.JvmRouteBinderValve.invoke(JvmRouteBinderValve.java:219)
at org.apache.catalina.ha.tcp.ReplicationValve.invoke(ReplicationValve.java:335)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:200)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
[2016-04-02 11:28:03,372] [CustId=1] Email message "Customer ทดสอบ1 has been created" to surasak@progress.in.th
[2016-04-02 11:28:06,970] [SID=D0AB7705194016FFD1905A0AF779014C3FFEE3BBEC9A.Pas_Instance] [CustId=1] [IP=10.101.7.16] ===> Error in thread catalina-exec-1825 at 04/02/2016 11:28 AM
[2016-04-02 11:28:06,970] java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:378)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:473)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:203)
at sun.net.www.http.HttpClient.New(HttpClient.java:290)
at sun.net.www.http.HttpClient.New(HttpClient.java:306)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:995)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:931)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:849)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1090)
at p20.a617.sendRequestWithToken(a617.java:120)
at p21.a678.getRuntimeStatus(a678.java:99)
at com.rb.core.ui.web.field.RuntimeStatus.appendRowDataJSON(RuntimeStatus.java:112)
at com.rb.core.ui.web.field.RuntimeStatus.appendViewJSON(RuntimeStatus.java:161)
at com.rb.core.ui.web.cell.FieldWrapper.appendViewJSON(FieldWrapper.java:447)
at com.rb.core.ui.web.cell.FieldWrapper.appendJSON(FieldWrapper.java:387)
at com.rb.core.ui.web.PageSection.appendJSONAllCellsData(PageSection.java:525)
at com.rb.core.ui.web.PageSection.appendJSONInternal(PageSection.java:489)
at com.rb.core.ui.web.PageSection.appendJSON(PageSection.java:434)
at com.rb.core.ui.web.WebPage.getRuntimeJSONForNonEmptyPage(WebPage.java:2318)
at com.rb.core.ui.web.WebPage.appendPageDataJSON(WebPage.java:1055)
at com.rb.core.ui.web.WebPage.appendPageContentJSON(WebPage.java:909)
at com.rb.core.ui.web.WebPage.getRuntimeJavaScript(WebPage.java:1015)
at p19.a158.getPageJsonConfigScript(a158.java:3358)
at com.rb.core.logics.servlet.MainServlet.generateNewUI(MainServlet.java:295)
at com.rb.core.logics.servlet.MainServlet.doGet(MainServlet.java:188)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.util.web.NoCacheFilter.doFilter(NoCacheFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.core.logics.filter.SessionTimestampFilter.doFilter(SessionTimestampFilter.java:56)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.rb.util.web.RequestLoggingFilter.doFilter(RequestLoggingFilter.java:36)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at org.apache.catalina.valves.StuckThreadDetectionValve.invoke(StuckThreadDetectionValve.java:193)
at org.apache.catalina.valves.CrawlerSessionManagerValve.invoke(CrawlerSessionManagerValve.java:180)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:314)
at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:305)
at org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:83)
at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:305)
at org.apache.catalina.valves.RemoteHostValve.invoke(RemoteHostValve.java:83)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.ha.session.JvmRouteBinderValve.invoke(JvmRouteBinderValve.java:219)
at org.apache.catalina.ha.tcp.ReplicationValve.invoke(ReplicationValve.java:335)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:200)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Have any suggestion ?
TIA,
Surasak M.
Hello Surasak,
Is this problem still happening?
Based on the provided information it appears error started suddenly.
Were there any changes to the configuration? Any problems with network connectivity?
Thanks, Karthikeyan
Has this question also been posted via a Support case? -Karthikeyan
Hello Karthikeyan,
No, it's not. This error raise in multi-server Production server. That mean, I have 1 server for master, rest, router, search, storage, web api and work flow. And 2 servers for each of prod.
For currently, I changed my environment with move 2 prods into the same host of master and then this error disappear.
I do not know what is rollbase communicate between master server and each prod server ?
when I maintain tenant such as create, delete or push update application.
Thanks,
Surasak M.