Java HeapSpace errors

Posted by James Palmer on 11-Dec-2014 05:53

Good morning, 

I was wondering if I could have some assistance dealing with an AppServer issue we are having more and more frequently of late. We are running Progress 11.2.1 32 bit on Windows 2008 R2 32 bit. We have a plan in process to migrate to 64bit OS and Executables on a new server, but that will be around Easter time due to business limitations on downtime. 

So as you can see resources are significantly limited due to the bitness issues. 

For the second time this week we have had our Stateless AppServer crash, needing to be forcibly terminated and restarted. The following is in the broker log:

[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- Cannot write response message. (8420)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- java.net.SocketException: Connection reset by peer: socket write error
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at java.net.SocketOutputStream.socketWrite0(Native Method)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at java.io.BufferedOutputStream.write(BufferedOutputStream.java:104)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at com.progress.ubroker.util.MsgOutputStream.writeMsgbuf(MsgOutputStream.java:223)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at com.progress.ubroker.util.MsgOutputStream.writeMsg(MsgOutputStream.java:115)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.sendClientRsp(ubClientThread.java:2210)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at com.progress.ubroker.broker.ubASclientThread.processDequeueLast(ubASclientThread.java:530)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.processEvent(ubClientThread.java:1215)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.mainline(ubClientThread.java:438)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.run(ubClientThread.java:359)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- Unhandled exception caught in S-0026. (8419)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- java.lang.OutOfMemoryError: Java heap space
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.util.MsgInputStream.readMsgbuf(MsgInputStream.java:395)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.util.MsgInputStream.readMsg(MsgInputStream.java:239)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.broker.ubServerSocketsIPC.read(ubServerSocketsIPC.java:279)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.broker.ubServerThread.getServerIPCMsg(ubServerThread.java:2515)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.broker.ubServerThread.getServerIPCEvent(ubServerThread.java:3129)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.broker.ubServerThread.solicitEvent(ubServerThread.java:878)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.broker.ubServerThread.mainline(ubServerThread.java:453)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- 	at com.progress.ubroker.broker.ubServerThread.run(ubServerThread.java:344)
[14/12/11@11:35:28.097+0000] P-009876 T-C-0008 1 UB ----------- Server Terminated Abnormally (8420)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- Unhandled exception caught in C-0003. (8419)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- java.lang.OutOfMemoryError: Java heap space
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at java.io.BufferedInputStream.<init>(BufferedInputStream.java:178)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at com.progress.ubroker.util.MsgInputStream.<init>(MsgInputStream.java:77)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.openIOStreams(ubClientThread.java:565)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.processStartup(ubClientThread.java:1981)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at com.progress.ubroker.broker.ubASclientThread.processStartup(ubASclientThread.java:864)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.processEvent(ubClientThread.java:1238)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.mainline(ubClientThread.java:438)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- 	at com.progress.ubroker.broker.ubClientThread.run(ubClientThread.java:359)
[14/12/11@11:37:30.183+0000] P-009876 T-S-0022 1 UB ----------- Unhandled exception caught in S-0022. (8419)
[14/12/11@11:37:30.183+0000] P-009876 T-S-0022 1 UB ----------- java.lang.OutOfMemoryError: Java heap space
[14/12/11@11:38:22.265+0000] P-009876 T-C-0005 1 UB ----------- Server Terminated Abnormally (8420)


Any help getting to the bottom of this great;y appreciated. 

OpenEdge RDBMS - Forum

All Replies

Posted by Libor Laubacher on 11-Dec-2014 05:56

Increase -Xmx for the particular broker. I am guessing you are passing large temp-tables or something large chunks of data back and forth.
 
[collapse]
From: James Palmer [mailto:bounce-jdpjamesp@community.progress.com]
Sent: Thursday, December 11, 2014 12:54 PM
To: TU.OE.RDBMS@community.progress.com
Subject: [Technical Users - OE RDBMS] Java HeapSpace errors
 
Thread created by James Palmer

Good morning, 

I was wondering if I could have some assistance dealing with an AppServer issue we are having more and more frequently of late. We are running Progress 11.2.1 32 bit on Windows 2008 R2 32 bit. We have a plan in process to migrate to 64bit OS and Executables on a new server, but that will be around Easter time due to business limitations on downtime. 

So as you can see resources are significantly limited due to the bitness issues. 

For the second time this week we have had our Stateless AppServer crash, needing to be forcibly terminated and restarted. The following is in the broker log:

[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- Cannot write response message. (8420)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB ----------- java.net.SocketException: Connection reset by peer: socket write error
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at java.net.SocketOutputStream.socketWrite0(Native Method)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at java.io.BufferedOutputStream.write(BufferedOutputStream.java:104)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at com.progress.ubroker.util.MsgOutputStream.writeMsgbuf(MsgOutputStream.java:223)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at com.progress.ubroker.util.MsgOutputStream.writeMsg(MsgOutputStream.java:115)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.sendClientRsp(ubClientThread.java:2210)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at com.progress.ubroker.broker.ubASclientThread.processDequeueLast(ubASclientThread.java:530)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.processEvent(ubClientThread.java:1215)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.mainline(ubClientThread.java:438)
[14/12/11@10:06:41.053+0000] P-009876 T-C-0008 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.run(ubClientThread.java:359)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- Unhandled exception caught in S-0026. (8419)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB ----------- java.lang.OutOfMemoryError: Java heap space
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.util.MsgInputStream.readMsgbuf(MsgInputStream.java:395)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.util.MsgInputStream.readMsg(MsgInputStream.java:239)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.broker.ubServerSocketsIPC.read(ubServerSocketsIPC.java:279)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.broker.ubServerThread.getServerIPCMsg(ubServerThread.java:2515)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.broker.ubServerThread.getServerIPCEvent(ubServerThread.java:3129)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.broker.ubServerThread.solicitEvent(ubServerThread.java:878)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.broker.ubServerThread.mainline(ubServerThread.java:453)
[14/12/11@11:35:27.063+0000] P-009876 T-S-0026 1 UB -----------      at com.progress.ubroker.broker.ubServerThread.run(ubServerThread.java:344)
[14/12/11@11:35:28.097+0000] P-009876 T-C-0008 1 UB ----------- Server Terminated Abnormally (8420)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- Unhandled exception caught in C-0003. (8419)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB ----------- java.lang.OutOfMemoryError: Java heap space
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at java.io.BufferedInputStream.<init>(BufferedInputStream.java:178)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at com.progress.ubroker.util.MsgInputStream.<init>(MsgInputStream.java:77)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.openIOStreams(ubClientThread.java:565)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.processStartup(ubClientThread.java:1981)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at com.progress.ubroker.broker.ubASclientThread.processStartup(ubASclientThread.java:864)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.processEvent(ubClientThread.java:1238)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.mainline(ubClientThread.java:438)
[14/12/11@11:36:17.580+0000] P-009876 T-C-0003 1 UB -----------      at com.progress.ubroker.broker.ubClientThread.run(ubClientThread.java:359)
[14/12/11@11:37:30.183+0000] P-009876 T-S-0022 1 UB ----------- Unhandled exception caught in S-0022. (8419)
[14/12/11@11:37:30.183+0000] P-009876 T-S-0022 1 UB ----------- java.lang.OutOfMemoryError: Java heap space
[/collapse]

Posted by James Palmer on 11-Dec-2014 05:59

Thanks Libor. What are the implications on memory (we're limited to 3.6GB due to the bitness of the server) and where do I set this for the broker?

Posted by James Palmer on 11-Dec-2014 06:01

Also, what is the default value? Ours is presumably using default values.

Posted by Libor Laubacher on 11-Dec-2014 06:04

In ubroker.properties the [UBroker.AS.brokename] section jvmArgs=-Xmx256m
 
I think the default is 32 or 64 depending on java version, so you can maybe start with 128m.
 
I am not aware of any implications other that it will use use/take more memory out of the ‘OS memory pool’.
 
[collapse]
From: James Palmer [mailto:bounce-jdpjamesp@community.progress.com]
Sent: Thursday, December 11, 2014 1:00 PM
To: TU.OE.RDBMS@community.progress.com
Subject: RE: [Technical Users - OE RDBMS] Java HeapSpace errors
 
Reply by James Palmer

Thanks Libor. What are the implications on memory (we're limited to 3.6GB due to the bitness of the server) and where do I set this for the broker?

Stop receiving emails on this subject.

Flag this post as spam/abuse.

[/collapse]

Posted by James Palmer on 11-Dec-2014 06:04

Thanks Libor.

Posted by James Palmer on 11-Dec-2014 06:06

Ok that's implemented at 128. See how we go.

Posted by Libor Laubacher on 11-Dec-2014 06:10

Double it then.
 
[collapse]
From: James Palmer [mailto:bounce-jdpjamesp@community.progress.com]
Sent: Thursday, December 11, 2014 1:08 PM
To: TU.OE.RDBMS@community.progress.com
Subject: RE: [Technical Users - OE RDBMS] Java HeapSpace errors
 
Reply by James Palmer

Ok that's implemented at 128. See how we go.

Stop receiving emails on this subject.

Flag this post as spam/abuse.

[/collapse]

Posted by Libor Laubacher on 11-Dec-2014 06:11

Ah my bad. Ignore my previous post. I need to learn how to read J
 
[collapse]
From: James Palmer [mailto:bounce-jdpjamesp@community.progress.com]
Sent: Thursday, December 11, 2014 1:08 PM
To: TU.OE.RDBMS@community.progress.com
Subject: RE: [Technical Users - OE RDBMS] Java HeapSpace errors
 
Reply by James Palmer

Ok that's implemented at 128. See how we go.

Stop receiving emails on this subject.

Flag this post as spam/abuse.

[/collapse]

Posted by James Palmer on 11-Dec-2014 06:11

lol thanks Libor - appreciate the swift response.

Posted by Stefan Drissen on 11-Dec-2014 17:44

[quote user="James Palmer"]

Good morning, 

I was wondering if I could have some assistance dealing with an AppServer issue we are having more and more frequently of late. We are running Progress 11.2.1 32 bit on Windows 2008 R2 32 bit. We have a plan in process to migrate to 64bit OS and Executables on a new server, but that will be around Easter time due to business limitations on downtime. 

[/quote]

Where did you get a 32-bit version of 2008R2? 2008R2 is only shipped as a 64-bit OS.

Posted by James Palmer on 11-Dec-2014 19:59

Sorry good point got my writes crossed. I meant 2003 server.

James Palmer | Application Developer
Tel: 01253 785103
[collapse]From: Stefan Drissen
Sent: ‎11/‎12/‎2014 23:46
To: TU.OE.RDBMS@community.progress.com
Subject: RE: [Technical Users - OE RDBMS] Java HeapSpace errors

Reply by Stefan Drissen

James Palmer

Good morning, 

I was wondering if I could have some assistance dealing with an AppServer issue we are having more and more frequently of late. We are running Progress 11.2.1 32 bit on Windows 2008 R2 32 bit. We have a plan in process to migrate to 64bit OS and Executables on a new server, but that will be around Easter time due to business limitations on downtime. 

Where did you get a 32-bit version of 2008R2? 2008R2 is only shipped as a 64-bit OS.

Stop receiving emails on this subject.

Flag this post as spam/abuse.



This email has been scanned for email related threats and delivered safely by Mimecast.
For more information please visit http://www.mimecast.com
[/collapse]

This thread is closed