Forgot your password?    
+ Reply to Thread
Results 1 to 2 of 2

Thread: Issues regarding FULL GCs in JVMs and JVM crashing in 11.5.10 EBS environment

  1. #1
    Oracle DBA
    Join Date
    Feb 2012
    Posts
    2

    Issues regarding FULL GCs in JVMs and JVM crashing in 11.5.10 EBS environment

    Hi Hemant ,

    We are having Oracle 11.5.10 EBS on Solaris v10 environment.We have a lot of customized JVMs.The issue is that we are seeing a lot of FULL GCs happening.Every now and then we have to go ahead and bounce JVMs.

    1. The question is that should we increase the number of JVMS or should we increase the memory for oacore JVM ?

    Apart from the common and known FULL GC problem we are seeing some cases of JVMs being crashed ?What should be done in that context ?Also seeing some SIGSEGV (0xb) error messages.

    Attached below are a few logs

    pacheJServ/1.1.2
    17.149: [Full GC 17.149: [Tenured: 0K->6494K(2097152K), 0.2620997 secs] 369161K->6494K(3040896K), [Perm : 20479K->20479K(20480K)], 0.2622002 secs] [Times: user=0.23 sys=0.03, real=0.26 secs]
    19.368: [Full GC 19.368: [Tenured: 6494K->29321K(2097152K), 0.4068512 secs] 164210K->29321K(3040896K), [Perm : 24575K->24575K(24576K)], 0.4069453 secs] [Times: user=0.44 sys=0.04, real=0.41 secs]
    23.518: [Full GC 23.518: [Tenured: 29321K->35485K(2097152K), 0.4443813 secs] 176974K->35485K(3040896K), [Perm : 28671K->28671K(28672K)], 0.4444891 secs] [Times: user=0.44 sys=0.01, real=0.45 secs]
    35.941: [Full GC 35.941: [Tenured: 35485K->90007K(2097152K), 1.2462688 secs] 466220K->90007K(3040896K), [Perm : 32767K->32734K(32768K)], 1.2464479 secs] [Times: user=1.13 sys=0.12, real=1.25 secs]
    66.462: [GC 66.463: [ParNew: 838912K->30369K(943744K), 0.1422070 secs] 928919K->120377K(3040896K), 0.1423078 secs] [Times: user=0.30 sys=0.07, real=0.14 secs]
    152.158: [Full GC 152.159: [Tenured: 90007K->121644K(2097152K), 1.1500280 secs] 392126K->121644K(3040896K), [Perm : 36863K->36863K(36864K)], 1.1501347 secs] [Times: user=1.10 sys=0.06, real=1.15 secs]
    #
    # An unexpected error has been detected by Java Runtime Environment:
    #
    # SIGSEGV (0xb) at pc=0x30fb9d9c, pid=16529, tid=177
    #
    # Java VM: Java HotSpot(TM) Server VM (10.0-b23 mixed mode solaris-sparc)
    # Problematic frame:
    # C [libclntsh.so.1.0+0x3b9d9c] lmmstmalloc+0x98
    #
    # An error report file with more information is saved as:
    # /tmp/hs_err_pid16529.log
    #
    # If you would like to submit a bug report, please visit:
    # http://java.sun.com/webapps/bugreport/crash.jsp
    # The crash happened outside the Java Virtual Machine in native code.
    # See problematic frame for where to report the bug.




    -------------------------------
    ApacheJServ/1.1.2
    84.383: [GC 84.383: [ParNew: 838912K->3562K(943744K), 0.0350376 secs] 838912K->3562K(3040896K), 0.0352129 secs] [Times: user=0.05 sys=0.02, real=0.04 secs]
    93.152: [Full GC 93.152: [Tenured: 0K->9532K(2097152K), 0.2655026 secs] 119853K->9532K(3040896K), [Perm : 20480K->20480K(20480K)], 0.2656161 secs] [Times: user=0.23 sys=0.04, real=0.27 secs]
    96.614: [Full GC 96.614: [Tenured: 9532K->33298K(2097152K), 0.4415069 secs] 156676K->33298K(3040896K), [Perm : 24575K->24575K(24576K)], 0.4416105 secs] [Times: user=0.40 sys=0.04, real=0.44 secs]
    99.774: [Full GC 99.774: [Tenured: 33298K->34887K(2097152K), 0.4126538 secs] 86810K->34887K(3040896K), [Perm : 28671K->28671K(28672K)], 0.4127524 secs] [Times: user=0.41 sys=0.00, real=0.41 secs]
    112.815: [Full GC 112.816: [Tenured: 34887K->58757K(2097152K), 0.7832952 secs] 240990K->58757K(3040896K), [Perm : 32767K->32737K(32768K)], 0.7833973 secs] [Times: user=0.74 sys=0.04, real=0.78 secs]

    Please suggest what should be done to improve on the above mentioned scenario

    Regards

    Chitiz

  2. #2
    Expert Oracle Administrator
    Join Date
    Oct 2011
    Location
    New Delhi, India
    Posts
    427
    Please send to me your jserv.conf and jserv.properties,oprocmgr.conf.
    Also send me your mod_jserv.log and entries in your dbc file.

    When jvm crashes , mod_oprocmgr on 11i should automatically take care of death detection and restart , so it should not require manual intervention to bounce jvm. I would first want to check the load balancing configuration for the jvms in jserv.conf.

    Also , Is your jvm crashing after an interval , or when there are more JDBC connections,
    please use this script to monitor the number of JDBC connections , during high usage : Script-to-Monitor-JDBC-Connections-on-the-Database


    Regarding , increasing memory or number of jvms :
    ======================================
    - After allocating a limit of 2 GB of memory for a JVM , go for increasing the number of JVMs
    - If your JVMs are crashing , make sure you have more than one jvm for each jserv container (eg: for oacore)
    - We should take into account the number of jdbc connections on database and size the max connections in the dbc file (for connections per jvm) , for JVM count determination.
    - I always recommend providing the same values for Xms and Xmx for the jvm memory allocation.

+ Reply to Thread

Similar Threads

  1. Understand Apache in Apps 11i environment
    By mdmasood in forum Concepts,Service Management,Apache,OC4J,OPMN,JServ,Forms, Issues,Troubleshooting,
    Replies: 5
    Last Post: 11-03-2012, 12:56 AM
  2. mountpoint gets full
    By saioracleappsdba in forum Concepts,Service Management,Apache,OC4J,OPMN,JServ,Forms, Issues,Troubleshooting,
    Replies: 4
    Last Post: 08-31-2012, 11:43 PM
  3. Oracle Discoverer 4i is crashing
    By mdmasood in forum Concepts,Service Management,Apache,OC4J,OPMN,JServ,Forms, Issues,Troubleshooting,
    Replies: 7
    Last Post: 06-07-2012, 03:37 PM
  4. How to get a clean Autoconfig Environment
    By Amit in forum AD Utilities , Autoconfig , FND Utilities
    Replies: 0
    Last Post: 11-01-2011, 02:03 PM
  5. Archivelog gets full
    By ajaysingh in forum Core Database Administration and Monitoring
    Replies: 7
    Last Post: 11-01-2011, 11:41 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

DBA Lounge (P) Ltd. deals in Oracle Technologies on Consulting, Resourcing, Corporate Training


Online and corporate training available on Oracle Database 11g, Oracle 11g Real Application Cluster (RAC), Oracle Applications 11i/R12, Oracle Fusion Middleware 11g, Oracle Identity Management-OIM, Oracle Internet Directory 11g-OID, Oracle Business Intelligence Enterprise Edition-OBIEE, Oracle Golden Gate, Oracle Access Management-OAM, Oracle Internet Directory-ODS, Oracle Identity Analytics Architecture-OIA Statistics