Connecting a pacific application server fails

Posted by Kai Siegele on 09-Mar-2017 09:43

Hallo,

I am using the 64-bit version of Open Edge 11.6.3 under Windows 10. I have created a new pacific application server and a good old application server. Now I want to compare the speed of both when accessing some queries.

For that purpose I have written a batch invoking a progress procedure several times. This procedure creates a server handle, invokes the connect-method for that handle and starts a procedure running on the server.

Everything works fine. Connecting the good old application server works without any problems. Only sometimes trying to connect the pacific application server fails with an exception. When catching the exception of type Progress.Lang.Error I cannot retrieve an error message and the call stack is not specified.

Has anyone an idea why I get this exception for the pacific application server and how to correct this error? Or where to find further information in one of the log-files?

Kind regards

Kai Siegele

All Replies

Posted by Irfan on 09-Mar-2017 09:47

Hi Kai,

In your PASOE Instance, the logs can be found in <PASOE Instance/logs folder. You can see logs with <PASOE Instance>.agent.log and <PASOE Instance>.<data>.log. If you have errors with ABL in the agent, then you should be seeing them in <PASOE Instance>.agent.log.

Posted by Peter Judge on 09-Mar-2017 09:50

All the logs generated by the PASOE instance are in $CATALINA_BASE/logs ($CATALINA_BASE is the instance root; c:/OpenEdge/WRK/oepas1 for  example).
 
Logging for the agent.log is controlled via  $CATALINA_BASE/conf/openedge.properties  and the agentLog* properties
 
agentLogEntryTypes=ASPlumbing,DB.Connects
agentLogFile=c:\devarea\pas\116\mediaresource/logs/mediaresource.agent.log
agentLoggingLevel=4
 
The Tomcat logging is controlled  with $CATALINA_BASE/conf/logging.properties and similar settings in the webapps’ WEB-INF/logging.xml
 

Posted by Kai Siegele on 10-Mar-2017 04:27

Hallo,

thank you for your replies.

The agent.log-file was the first file where I digged for further information. Unfortunately I have not found any hint why connecting the pacific application server fails.

Has anyone an idea?

Kind regards

Kai Siegele

Posted by Irfan on 10-Mar-2017 09:06

Hi Kai,

As Peter suggested, did you try to bump up the logging and see if you get any information there. Even after dong that If you do not find any information there then look at the <PASOE Instance>.date.log. This should give information about any connection problems to the agent.

Posted by Kai Siegele on 13-Mar-2017 05:09

Hallo Irfan,

it's not the problem that I find no Information, it's the problem that I find no useful information.

In the <PASOE Instance>.date.log for example I find such helpful messages like:

09:55:29.868/4353773 [catalina-exec-2] ERROR com.progress.O4gl.Trace - READPACKET IOException : java.net.SocketException: Connection reset (Connection reset)

java.net.SocketException: Connection reset

at java.net.SocketInputStream.read(SocketInputStream.java:196) ~[na:1.7.0_45]

at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_45]

at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_45]

at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_45]

at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_45]

at com.progress.ubroker.client.TcpClientMsgInputStream.readstream(TcpClientMsgInputStream.java:598) ~[o4glrt.jar:na]

at com.progress.ubroker.client.TcpClientMsgInputStream.readubhdr(TcpClientMsgInputStream.java:389) ~[o4glrt.jar:na]

at com.progress.ubroker.client.TcpClientMsgInputStream.readMsg(TcpClientMsgInputStream.java:289) ~[o4glrt.jar:na]

at com.progress.ubroker.client.BrokerSystem.readMsg(BrokerSystem.java:3124) [o4glrt.jar:na]

at com.progress.ubroker.client.BrokerSystem.readPacket(BrokerSystem.java:2919) [o4glrt.jar:na]

at com.progress.ubroker.client.BrokerSystem.read(BrokerSystem.java:1469) [o4glrt.jar:na]

at com.progress.ubroker.client.BrokerSystem.read(BrokerSystem.java:1412) [o4glrt.jar:na]

at com.progress.open4gl.dynamicapi.SinkInputStream.read(SinkInputStream.java:58) [o4glrt.jar:na]

at com.progress.open4gl.dynamicapi.OutputParamReader.<init>(OutputParamReader.java:39) [o4glrt.jar:na]

at com.progress.open4gl.dynamicapi.Session.runProcedure0(Session.java:1174) [o4glrt.jar:na]

at com.progress.open4gl.dynamicapi.Session.runProcedure(Session.java:830) [o4glrt.jar:na]

at com.progress.open4gl.dynamicapi.Session.runStatelessProcedure(Session.java:736) [o4glrt.jar:na]

at com.progress.open4gl.dynamicapi.PersistentProc.runTheProcedure(PersistentProc.java:188) [o4glrt.jar:na]

at com.progress.open4gl.dynamicapi.PersistentProc.runProcedure(PersistentProc.java:145) [o4glrt.jar:na]

at com.progress.open4gl.javaproxy.Procedure.runProcedure(Procedure.java:247) [o4glrt.jar:na]

at com.progress.open4gl.javaproxy.Procedure.runProcedure(Procedure.java:190) [o4glrt.jar:na]

at com.progress.open4gl.javaproxy.OpenClassObjectImpl.invokeMethod(OpenClassObjectImpl.java:59) [o4glrt.jar:na]

at com.progress.open4gl.javaproxy.OpenClassObject.invokeMethod(OpenClassObject.java:133) [o4glrt.jar:na]

at com.progress.appserv.broker.agent.TcpAgent.terminateABLSession(TcpAgent.java:754) [oebroker.11.6.3.jar:na]

at com.progress.appserv.broker.session.LocalSession.shutdownABLSession(LocalSession.java:2948) [oebroker.11.6.3.jar:na]

at com.progress.appserv.broker.session.LocalSession.shutdownSession(LocalSession.java:2892) [oebroker.11.6.3.jar:na]

at com.progress.appserv.broker.session.LocalSession.stopSession(LocalSession.java:384) [oebroker.11.6.3.jar:na]

at com.progress.appserv.broker.session.LocalSessionPool.stopOrphanSession(LocalSessionPool.java:1110) [oebroker.11.6.3.jar:na]

at com.progress.appserv.broker.session.LocalSessionPool.stopSession(LocalSessionPool.java:581) [oebroker.11.6.3.jar:na]

at com.progress.appserv.adapters.aia.Aia.processConnect(Aia.java:1516) [oeapsv.11.6.3.jar:na]

at com.progress.appserv.adapters.aia.Aia.doPost(Aia.java:561) [oeapsv.11.6.3.jar:na]

at javax.servlet.http.HttpServlet.service(HttpServlet.java:650) [servlet-api.jar:na]

at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) [servlet-api.jar:na]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) [catalina.jar:7.0.70]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) [catalina.jar:7.0.70]

at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) [tomcat7-websocket.jar:7.0.70]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) [catalina.jar:7.0.70]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) [catalina.jar:7.0.70]

at com.progress.appserv.oeabl.OEAblServletFilter.doFilter(OEAblServletFilter.java:72) [oeablservice.11.6.3.jar:na]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) [catalina.jar:7.0.70]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) [catalina.jar:7.0.70]

at ch.qos.logback.classic.selector.servlet.LoggerContextFilter.doFilter(LoggerContextFilter.java:70) [logback-classic-1.0.13.jar:na]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) [catalina.jar:7.0.70]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) [catalina.jar:7.0.70]

at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:186) [spring-security-web-3.1.4.RELEASE.jar:3.1.4.RELEASE]

at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) [spring-security-web-3.1.4.RELEASE.jar:3.1.4.RELEASE]

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:343) [spring-web-3.2.4.RELEASE.jar:3.2.4.RELEASE]

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:260) [spring-web-3.2.4.RELEASE.jar:3.2.4.RELEASE]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) [catalina.jar:7.0.70]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) [catalina.jar:7.0.70]

at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:218) [catalina.jar:7.0.70]

at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) [catalina.jar:7.0.70]

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) [catalina.jar:7.0.70]

at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) [catalina.jar:7.0.70]

at org.apache.catalina.valves.StuckThreadDetectionValve.invoke(StuckThreadDetectionValve.java:220) [catalina.jar:7.0.70]

at org.apache.catalina.valves.CrawlerSessionManagerValve.invoke(CrawlerSessionManagerValve.java:180) [catalina.jar:7.0.70]

at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) [catalina.jar:7.0.70]

at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:270) [catalina.jar:7.0.70]

at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:334) [catalina.jar:7.0.70]

at org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:119) [catalina.jar:7.0.70]

at org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:334) [catalina.jar:7.0.70]

at org.apache.catalina.valves.RemoteHostValve.invoke(RemoteHostValve.java:119) [catalina.jar:7.0.70]

at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) [catalina.jar:7.0.70]

at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:442) [catalina.jar:7.0.70]

at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1082) [tomcat-coyote.jar:7.0.70]

at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:623) [tomcat-coyote.jar:7.0.70]

at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) [tomcat-coyote.jar:7.0.70]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]

at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-coyote.jar:7.0.70]

at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]

09:55:29.868/4353773 [catalina-exec-2] ERROR com.progress.O4gl.Trace - DISCONNECT IOException:  java.net.SocketException: Connection reset by peer: socket write error

09:55:29.868/4353773 [catalina-exec-2] ERROR com.progress.appserv.Agent - terminateABLSession(cg1iKK8ES-mCldpMetp-1Q,B9CBD25A054C6C426B211027798B30E51F766CAC1C08.oepas1,IMMEDIATE) fehlgeschlagen: OpenAPI-Ausnahme aufgetreten: com.progress.open4gl.Open4GLException: Kommunikationsschichtnachricht : General Error: READPACKET IOException : java.net.SocketException: Connection reset (Connection reset). (7175):Kommunikationsschichtnachricht : General Error: READPACKET IOException : java.net.SocketException: Connection reset (Connection reset). (7175) (18236)

09:55:29.868/4353773 [catalina-exec-2] ERROR com.progress.appserv.Agent - terminateABLSession(cg1iKK8ES-mCldpMetp-1Q, B9CBD25A054C6C426B211027798B30E51F766CAC1C08.oepas1, IMMEDIATE) : OpenAPI exception com.progress.open4gl.Open4GLException: Kommunikationsschichtnachricht : General Error: READPACKET IOException : java.net.SocketException: Connection reset (Connection reset). (7175)

09:55:29.868/4353773 [catalina-exec-2] ERROR com.progress.appserv.Session - LocalSession(B9CBD25A054C6C426B211027798B30E51F766CAC1C08.oepas1): Fehler beim Herunterfahren der ABL-Sitzung NULL - ungültiger Agent cg1iKK8ES-mCldpMetp-1Q. (18306)

09:55:30.874/4354779 [catalina-exec-4] ERROR com.progress.appserv.Agent - TcpAgentConnection(Kp98x-RgRx645jNArsnNQA): Fehler beim Öffnen einer Verbindung für die URL (AppServerDC://0.0.0.0:62003/) = java.net.ConnectException: Connection refused: connect:Connection refused: connect (18263)

09:55:30.874/4354779 [catalina-exec-4] ERROR com.progress.appserv.Agent - TcpAgentConnectionPool(VLM47l15QT69mUIwdNGTQQ): Fehler beim Start einer neuen Verbindung zu AppServerDC://0.0.0.0:62003/ = com.progress.appserv.broker.exception.BrokerException$NetworkException: Agent:NetworkError[Error opening connection for (Kp98x-RgRx645jNArsnNQA) = java.net.ConnectException: Connection refused: connect]:Agent (18277)

09:55:30.882/4354787 [catalina-exec-7] ERROR com.progress.appserv.Session - LocalSession(FF3B0C3F1DBBBEA94C549A0847FFCDF88C62CE160F04.oepas1): Zeitüberschreitungs-Fehler bei der Reservierung einer Verbindung - com.progress.appserv.broker.exception.BrokerException$NoAvailableConnectionsException: Agent:No Available Connections[cannot start new agent]:Agent. (18298)

09:55:30.882/4354787 [shutdown-cg1iKK8ES-mCldpMetp-1Q] ERROR com.progress.appserv.Agent - TcpAgent(U9aYdyHfQnKYS2HLwOZoZQ,cg1iKK8ES-mCldpMetp-1Q): Fehler beim Senden der Herunterfahren-Anforderungen an den Agentprozess = com.progress.open4gl.Open4GLException: Versuchte eine Methode in einer ungültigen Prozedur aufzurufen. (7224):Versuchte eine Methode in einer ungültigen Prozedur aufzurufen. (7224) (18255)

09:55:30.882/4354787 [catalina-exec-8] ERROR com.progress.appserv.Session - LocalSession(52B53DE5D612AC39B4C1937E6AC6EC43E2D585E00D5F.oepas1): Zeitüberschreitungs-Fehler bei der Reservierung einer Verbindung - com.progress.appserv.broker.exception.BrokerException$NoAvailableConnectionsException: Agent:No Available Connections[cannot start new agent]:Agent. (18298)

09:55:30.894/4354799 [shutdown-cg1iKK8ES-mCldpMetp-1Q] ERROR com.progress.appserv.Agent - TcpAgent(U9aYdyHfQnKYS2HLwOZoZQ,cg1iKK8ES-mCldpMetp-1Q) : Error sending shutdown message to agent process = com.progress.open4gl.Open4GLException: Versuchte eine Methode in einer ungültigen Prozedur aufzurufen. (7224)

09:55:30.898/4354803 [catalina-exec-9] ERROR com.progress.appserv.Session - LocalSession(6E834E4C49F69D0DE3E04E73E32F186EFD6A0A2468B3.oepas1): Zeitüberschreitungs-Fehler bei der Reservierung einer Verbindung - com.progress.appserv.broker.exception.BrokerException$NoAvailableConnectionsException: Agent:No Available Connections[cannot start new agent]:Agent. (18298)

09:55:30.899/4354804 [catalina-exec-1] ERROR com.progress.appserv.Session - LocalSession(CD34019BC65C14D64C59561B4130D5239C302931AFA0.oepas1): Zeitüberschreitungs-Fehler bei der Reservierung einer Verbindung - com.progress.appserv.broker.exception.BrokerException$NoAvailableConnectionsException: Agent:No Available Connections[cannot start new agent]:Agent. (18298)

Has anyone an idea whether this exception is the reason for my problem? And where to find further information how to correct this errror?

Kind regards

Kai Siegele

Posted by Irfan on 13-Mar-2017 05:57

Hi Kai,

One of the error that I understand from these logs is that you were trying to PASOE Development environment with too many users and it cannot start new sessions. By default, in PASOE development you can run 5 concurrent sessions in MS-Agent. Am I right that you were sending more than 5 concurrent requests from your client ?

Posted by Kai Siegele on 13-Mar-2017 06:23

Hallo Irfan,

thanks for your answer but I have already decrease the number of invokes to 5. When starting my program f.e. 20 times I got the message: The system or the server has no more resource. Please increase -n.

Kind regards

Kai

Posted by Irfan on 13-Mar-2017 07:17

This is what I see from the logs

NoAvailableConnectionsException: Agent:No Available Connections[cannot start new agent]:Agent. (18298) - See more at: community.progress.com/.../100906

So it might be possible that you were running only 5 concurrent users, but you might be running the next iteration before the first 5 got finished.

This thread is closed