Question:
I am getting the following jvm crash every few days running Tomcat 6.0.16 on java 1.6.0_07.
The effect is tomcat dies instantly.
Any ideas what this means?
An unexpected error has been detected by Java Runtime Environment: EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d889bb3, pid=4228, tid=8264 Java VM: Java HotSpot(TM) Client VM (10.0-b23 mixed mode windows-x86) Problematic frame: V [jvm.dll+0x19bb3] If you would like to submit a bug report, please visit: http://java.sun.com/webapps/bugreport/crash.jsp --------------- T H R E A D --------------- Current thread (0x4ca02000): VMThread [stack: 0x4ca90000,0x4cae0000] [id=8264] siginfo: ExceptionCode=0xc0000005, reading address 0x616c632e Registers: EAX=0x4ce789a8, EBX=0x00000005, ECX=0x616c632e, EDX=0x00000000 ESP=0x4cadfc34, EBP=0x04598e70, ESI=0x00000000, EDI=0x4d068800 EIP=0x6d889bb3, EFLAGS=0x00010206 Top of Stack: (sp=0x4cadfc34) 0x4cadfc34: 4d66f034 4d66f034 4ca02428 4ca02420 0x4cadfc44: 00000005 ffffffff 4cadff74 77e61a60 0x4cadfc54: 77e61d48 6d88a32f 00000001 00000000 0x4cadfc64: 00000000 4ce78800 00292cd8 6da2f9df 0x4cadfc74: 4d66f034 00292cd8 4ca02420 00000000 0x4cadfc84: 004ef3fa 00000000 019db1de 4ca02814 0x4cadfc94: 6da2ec71 0000000b 002959d8 00000000 0x4cadfca4: 00000000 00000001 4f23e15b 4ca02428 Instructions: (pc=0x6d889bb3) 0x6d889ba3: d2 33 f6 85 c9 7e 67 8d 9b 00 00 00 00 8b 48 0c 0x6d889bb3: 8b 0c b1 39 29 75 09 8b 51 04 c7 02 00 00 00 00 Stack: [0x4ca90000,0x4cae0000], sp=0x4cadfc34, free space=319k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [jvm.dll+0x19bb3] VM_Operation (0x4d66f034): RevokeBias, mode: safepoint, requested by thread 0x4ce78800 --------------- P R O C E S S --------------- Java Threads: ( => current thread ) 0x4cf59400 JavaThread "Thread-7" daemon [_thread_blocked, id=6240, stack(0x4d430000,0x4d480000)] 0x4cef7c00 JavaThread "TP-Monitor" daemon [_thread_blocked, id=7080, stack(0x4d6c0000,0x4d710000)] 0x4cd25800 JavaThread "TP-Processor4" daemon [_thread_in_native, id=7660, stack(0x4d670000,0x4d6c0000)] 0x4ce78800 JavaThread "TP-Processor3" daemon [_thread_blocked, id=272, stack(0x4d620000,0x4d670000)] 0x4d068800 JavaThread "TP-Processor2" daemon [_thread_blocked, id=620, stack(0x4d5d0000,0x4d620000)] 0x4d068400 JavaThread "TP-Processor1" daemon [_thread_in_native, id=6132, stack(0x4d580000,0x4d5d0000)] 0x4cf69400 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=6088, stack(0x4d530000,0x4d580000)] 0x4d13a800 JavaThread "ObjectPoolCleaner" [_thread_blocked, id=5792, stack(0x4d4e0000,0x4d530000)] 0x4d069000 JavaThread "ObjectPoolCleaner" [_thread_blocked, id=9296, stack(0x4d360000,0x4d3b0000)] 0x4d091800 JavaThread "pool-1-thread-1" [_thread_blocked, id=7496, stack(0x4d310000,0x4d360000)] 0x4ca1f800 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=9860, stack(0x4cc70000,0x4ccc0000)] 0x4ca1b000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=5880, stack(0x4cc20000,0x4cc70000)] 0x4ca19c00 JavaThread "Attach Listener" daemon [_thread_blocked, id=7064, stack(0x4cbd0000,0x4cc20000)] 0x4ca18c00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=756, stack(0x4cb80000,0x4cbd0000)] 0x4ca09800 JavaThread "Finalizer" daemon [_thread_blocked, id=8240, stack(0x4cb30000,0x4cb80000)] 0x4ca05400 JavaThread "Reference Handler" daemon [_thread_blocked, id=7888, stack(0x4cae0000,0x4cb30000)] 0x00296400 JavaThread "main" [_thread_in_native, id=5184, stack(0x00840000,0x00890000)] Other Threads: =>0x4ca02000 VMThread [stack: 0x4ca90000,0x4cae0000] [id=8264] 0x4ca2a400 WatcherThread [stack: 0x4ccc0000,0x4cd10000] [id=6520] VM state:at safepoint (normal execution) VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event]) [0x002959a8/0x000006e4] Threads_lock - owner thread: 0x4ca02000 Heap def new generation total 72576K, used 33231K [0x02910000, 0x077d0000, 0x077d0000) eden space 64512K, 51% used [0x02910000, 0x04983fa0, 0x06810000) from space 8064K, 0% used [0x06ff0000, 0x06ff0000, 0x077d0000) to space 8064K, 0% used [0x06810000, 0x06810000, 0x06ff0000) tenured generation total 967936K, used 42171K [0x077d0000, 0x42910000, 0x42910000) the space 967936K, 4% used [0x077d0000, 0x0a0fee10, 0x0a0ff000, 0x42910000) compacting perm gen total 19456K, used 19349K [0x42910000, 0x43c10000, 0x4a910000) the space 19456K, 99% used [0x42910000, 0x43bf5460, 0x43bf5600, 0x43c10000) No shared spaces configured. Dynamic libraries: 0x00400000 - 0x00423000 C:\platform\software\jdk1.6.0_07\bin\java.exe 0x7c800000 - 0x7c8c2000 C:\WINDOWS\system32\ntdll.dll 0x77e40000 - 0x77f42000 C:\WINDOWS\system32\kernel32.dll 0x7d1e0000 - 0x7d27c000 C:\WINDOWS\system32\ADVAPI32.dll 0x77c50000 - 0x77cef000 C:\WINDOWS\system32\RPCRT4.dll 0x76f50000 - 0x76f63000 C:\WINDOWS\system32\Secur32.dll 0x7c340000 - 0x7c396000 C:\platform\software\jdk1.6.0_07\jre\bin\msvcr71.dll 0x6d870000 - 0x6dac0000 C:\platform\software\jdk1.6.0_07\jre\bin\client\jvm.dll 0x77380000 - 0x77411000 C:\WINDOWS\system32\USER32.dll 0x77c00000 - 0x77c49000 C:\WINDOWS\system32\GDI32.dll 0x76aa0000 - 0x76acd000 C:\WINDOWS\system32\WINMM.dll 0x76290000 - 0x762ad000 C:\WINDOWS\system32\IMM32.DLL 0x6d320000 - 0x6d328000 C:\platform\software\jdk1.6.0_07\jre\bin\hpi.dll 0x76b70000 - 0x76b7b000 C:\WINDOWS\system32\PSAPI.DLL 0x6d820000 - 0x6d82c000 C:\platform\software\jdk1.6.0_07\jre\bin\verify.dll 0x6d3c0000 - 0x6d3df000 C:\platform\software\jdk1.6.0_07\jre\bin\java.dll 0x6d860000 - 0x6d86f000 C:\platform\software\jdk1.6.0_07\jre\bin\zip.dll 0x6d620000 - 0x6d633000 C:\platform\software\jdk1.6.0_07\jre\bin\net.dll 0x71c00000 - 0x71c17000 C:\WINDOWS\system32\WS2_32.dll 0x77ba0000 - 0x77bfa000 C:\WINDOWS\system32\msvcrt.dll 0x71bf0000 - 0x71bf8000 C:\WINDOWS\system32\WS2HELP.dll 0x71b20000 - 0x71b61000 C:\WINDOWS\system32\mswsock.dll 0x5f270000 - 0x5f2ca000 C:\WINDOWS\system32\hnetcfg.dll 0x71ae0000 - 0x71ae8000 C:\WINDOWS\System32\wshtcpip.dll 0x68000000 - 0x68035000 C:\WINDOWS\system32\rsaenh.dll 0x76920000 - 0x769e2000 C:\WINDOWS\system32\USERENV.dll 0x71c40000 - 0x71c97000 C:\WINDOWS\system32\netapi32.dll 0x76ed0000 - 0x76efa000 C:\WINDOWS\system32\DNSAPI.dll 0x76f70000 - 0x76f77000 C:\WINDOWS\System32\winrnr.dll 0x76f10000 - 0x76f3e000 C:\WINDOWS\system32\WLDAP32.dll 0x76f80000 - 0x76f85000 C:\WINDOWS\system32\rasadhlp.dll 0x6d800000 - 0x6d808000 C:\platform\software\jdk1.6.0_07\jre\bin\sunmscapi.dll 0x761b0000 - 0x76243000 C:\WINDOWS\system32\CRYPT32.dll 0x76190000 - 0x761a2000 C:\WINDOWS\system32\MSASN1.dll VM Arguments: jvm_args: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=C:\platform\software\apache-tomcat-6.0.16\conf\logging.properties -Xms1024m -Xmx1024m -XX:MaxPermSize=128m -Djava.endorsed.dirs=C:\platform\software\apache-tomcat-6.0.16\endorsed -Dcatalina.base=C:\platform\software\apache-tomcat-6.0.16 -Dcatalina.home=C:\platform\software\apache-tomcat-6.0.16 -Djava.io.tmpdir=C:\platform\software\apache-tomcat-6.0.16\temp java_command: org.apache.catalina.startup.Bootstrap start Launcher Type: SUN_STANDARD Environment Variables: JAVA_HOME=C:\platform\software\jdk1.6.0_07 JRE_HOME=C:\platform\software\jdk1.6.0_07 OS=Windows_NT PROCESSOR_IDENTIFIER=x86 Family 6 Model 26 Stepping 5, GenuineIntel --------------- S Y S T E M --------------- OS: Windows Server 2003 family Build 3790 Service Pack 2 CPU:total 4 (1 cores per cpu, 1 threads per core) family 6 model 10 stepping 5, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3 Memory: 4k page, physical 2097151k(2097151k free), swap 4194303k(3879608k free) vm_info: Java HotSpot(TM) Client VM (10.0-b23) for windows-x86 JRE (1.6.0_07-b06), built on Jun 10 2008 01:14:11 by "java_re" with MS VC++ 7.1 time: Mon Aug 09 08:34:32 2010 elapsed time: 34039 seconds
Solution:1
I would try upgrading the JVM to the latest version. There have been many fixes since then.
Solution:2
It basically crashing with segfault in the JVM code. ExceptionCode=0xc0000005 means segfault. JVM thread(tid=0x4ca02000) tried to write at the address pointed by ECX=0x616c632e register,which looks to be inaccessible,and caused the segfault. I can see two reason based on the info provided,either its a object corruption issue due to access garbage collection or compaction in a java heap(possibly perm region--just a guess based on the occupancy shown in the heap stats) or may be a object corruption due to JIT compiled code.First is kinda difficult to figure out because it needs the system dump analysis,but looks like second one is easy to check by disabling JIT using -Xint option.You can try this and if it resolves the issue than possibly JIT is doing something bad.You can check in the latest release if something is fixed in JIT in recent time and can upgrade to latest version.
Solution:3
In my case it was a memory crash. It was fixed adding this argument to JVM launch configuration: -Xmx512M
Note:If u also have question or solution just comment us below or mail us on toontricks1994@gmail.com
EmoticonEmoticon