IIS 6 supporting 100+ domains; PHP5 and MySQL 5; plesk control panel; Wordpress 3.4; one site goes to 100% CPU; diagdump analysis is below; would love any help as to why this is happening.
Analysis Summary
Type Description Recommendation
Warning 1 client connection(s) in w3wp.exe__xxxxxx.com(domain)(pool)__PID__9728__Date__08_13_2012__Time_01_32_25PM__212__Manual Dump.dmp have been executing a request for more than 90 seconds. Please see the Client Connections section of this report for more detailed information about the connection(s).
Analysis Details
Table Of Contents
w3wp.exe__xxxxxx.com(domain)(pool)__PID__9728__Date__08_13_2012__Time_01_32_25PM__212__Manual Dump.dmp
Report for w3wp.exe__xxxxxx.com(domain)(pool)__PID__9728__Date__08_13_2012__Time_01_32_25PM__212__Manual Dump.dmp
Report for w3wp.exe__xxxxxx.com(domain)(pool)__PID__9728__Date__08_13_2012__Time_01_32_25PM__212__Manual Dump.dmp
Type of Analysis Performed Hang Analysis
Machine Name SLICK
Operating System Windows Server 2003 Service Pack 2
Number Of Processors 2
Process ID 9728
Process Image c:\WINDOWS\system32\inetsrv\w3wp.exe
System Up-Time 41 day(s) 21:55:22
Process Up-Time 19:46:04
Top 5 Threads by CPU time
Note - Times include both user mode and kernel mode for each thread Thread ID: 4 Total CPU Time: 00:29:22.437 Entry Point for Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
Thread ID: 5 Total CPU Time: 00:29:05.421 Entry Point for Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
Thread ID: 2 Total CPU Time: 00:27:27.624 Entry Point for Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
Thread ID: 3 Total CPU Time: 00:22:53.468 Entry Point for Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
Thread ID: 13 Total CPU Time: 00:19:18.468 Entry Point for Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
Thread report
Thread 0 - System ID 6380
Entry point w3wp!wmainCRTStartup
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:00:00.078
Time spent in kernel mode 0 Days 00:00:00.015
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
w3dt!WP_CONTEXT::RunMainThreadLoop+10
w3dt!UlAtqStartListen+2d
w3core!W3_SERVER::StartListen+bd
w3core!UlW3Start+26e
w3wp!wmain+22a
w3wp!wmainCRTStartup+12f
kernel32!BaseProcessStart+23
Back to Top
Thread 1 - System ID 11708
Entry point ntdll!RtlpTimerThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwDelayExecution+c
ntdll!RtlpTimerThread+47
kernel32!BaseThreadStart+34
Back to Top
Thread 2 - System ID 3980
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:08:54.906
Time spent in kernel mode 0 Days 00:18:32.718
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 3 - System ID 2092
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:07:37.00
Time spent in kernel mode 0 Days 00:15:16.468
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 4 - System ID 4292
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:09:31.812
Time spent in kernel mode 0 Days 00:19:50.625
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwOpenFile+c
kernel32!FindFirstFileExW+1c3
kernel32!FindFirstFileA+39
php5ts!virtual_file_ex+6d3
php5ts!php_stream_fopen+2c3
php5ts!php_stream_stat_path+112
php5ts!php_stat+234
Back to Top
Thread 5 - System ID 216
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:09:22.718
Time spent in kernel mode 0 Days 00:19:42.703
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 6 - System ID 7528
Entry point ntdll!RtlpWaitThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwWaitForMultipleObjects+c
ntdll!RtlpWaitThread+161
kernel32!BaseThreadStart+34
Back to Top
Thread 7 - System ID 11480
Entry point ISAPI_Rewrite!TerminateFilter+4f755
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
ISAPI_Rewrite!TerminateFilter+400d
ISAPI_Rewrite!TerminateFilter+4f72f
ISAPI_Rewrite!TerminateFilter+4f7d7
kernel32!BaseThreadStart+34
Back to Top
Thread 8 - System ID 6684
Entry point ISAPI_Rewrite!TerminateFilter+4f755
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
ISAPI_Rewrite+80ed
ISAPI_Rewrite!TerminateFilter+4f72f
ISAPI_Rewrite!TerminateFilter+4f7d7
kernel32!BaseThreadStart+34
Back to Top
Thread 9 - System ID 2148
Entry point w3core!HTTP_COMPRESSION::CompressionThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
w3core!HTTP_COMPRESSION::CompressionThread+126
kernel32!BaseThreadStart+34
Back to Top
Thread 10 - System ID 1780
Entry point ntdll!RtlpIOWorkerThread
Create time 8/12/2012 5:46:26 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwDelayExecution+c
ntdll!RtlpIOWorkerThread+3f
kernel32!BaseThreadStart+34
Back to Top
Thread 11 - System ID 8884
Entry point msvcrt!_endthreadex+2f
Create time 8/12/2012 5:46:34 PM
Time spent in user mode 0 Days 00:00:00.078
Time spent in kernel mode 0 Days 00:00:00.062
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
user32!NtUserGetMessage+c
php5ts!zend_timeout+1a8
Back to Top
Thread 12 - System ID 5808
Entry point ntdll!RtlpWorkerThread
Create time 8/13/2012 4:25:09 AM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
ntdll!RtlpWorkerThread+3d
kernel32!BaseThreadStart+34
Back to Top
Thread 13 - System ID 1492
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 8:55:08 AM
Time spent in user mode 0 Days 00:06:05.562
Time spent in kernel mode 0 Days 00:13:12.906
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtClose+c
kernel32!FindClose+5c
php5ts!virtual_file_ex+73c
php5ts!php_stream_fopen+2c3
php5ts!php_stream_stat_path+112
php5ts!php_stat+234
Back to Top
Thread 14 - System ID 11340
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 10:02:07 AM
Time spent in user mode 0 Days 00:05:27.281
Time spent in kernel mode 0 Days 00:11:51.187
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtClose+c
kernel32!FindClose+5c
php5ts!virtual_file_ex+73c
php5ts!php_stream_fopen+2c3
php5ts!php_stream_stat_path+112
php5ts!php_stat+234
Back to Top
Thread 15 - System ID 9212
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 11:11:02 AM
Time spent in user mode 0 Days 00:05:47.890
Time spent in kernel mode 0 Days 00:12:41.609
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 16 - System ID 5148
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 11:11:03 AM
Time spent in user mode 0 Days 00:04:55.656
Time spent in kernel mode 0 Days 00:10:40.250
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 17 - System ID 1984
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 11:11:04 AM
Time spent in user mode 0 Days 00:04:10.718
Time spent in kernel mode 0 Days 00:08:51.562
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwOpenFile+c
kernel32!FindFirstFileExW+1c3
kernel32!FindFirstFileA+39
php5ts!virtual_file_ex+6d3
php5ts!php_stream_fopen+2c3
php5ts!php_stream_stat_path+112
php5ts!php_stat+234
Back to Top
Thread 18 - System ID 6600
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 11:11:06 AM
Time spent in user mode 0 Days 00:04:35.796
Time spent in kernel mode 0 Days 00:09:54.453
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtClose+c
kernel32!FindClose+5c
php5ts!virtual_file_ex+73c
php5ts!php_stream_fopen+2c3
php5ts!php_stream_stat_path+112
php5ts!php_stat+234
Back to Top
Thread 19 - System ID 4412
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 11:11:49 AM
Time spent in user mode 0 Days 00:03:53.546
Time spent in kernel mode 0 Days 00:08:32.187
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwOpenFile+c
kernel32!FindFirstFileExW+1c3
kernel32!FindFirstFileA+39
php5ts!virtual_file_ex+6d3
php5ts!php_stream_fopen+2c3
php5ts!php_stream_stat_path+112
php5ts!php_stat+234
Back to Top
Thread 20 - System ID 11332
Entry point rpcrt4!ThreadStartRoutine
Create time 8/13/2012 11:56:07 AM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtReplyWaitReceivePortEx+c
rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+198
rpcrt4!RecvLotsaCallsWrapper+d
rpcrt4!BaseCachedThreadRoutine+9d
rpcrt4!ThreadStartRoutine+1b
kernel32!BaseThreadStart+34
Back to Top
Thread 21 - System ID 7836
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 12:12:52 PM
Time spent in user mode 0 Days 00:01:25.171
Time spent in kernel mode 0 Days 00:03:03.875
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 22 - System ID 5232
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 12:12:53 PM
Time spent in user mode 0 Days 00:03:03.859
Time spent in kernel mode 0 Days 00:06:48.109
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCall+2
ntdll!NtClose+c
kernel32!DeleteFileW+265
kernel32!DeleteFileA+19
msvcrt!remove+e
php5ts!virtual_unlink+8f
php5ts!efree+39
ZendOptimizer+e983
php5ts!execute+b48
php5ts!zval_copy_ctor_func+c2
php5ts!execute+245
php5ts!execute+1c5
ZendOptimizer+e983
Back to Top
Thread 23 - System ID 3828
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 12:35:22 PM
Time spent in user mode 0 Days 00:02:30.890
Time spent in kernel mode 0 Days 00:05:26.984
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 24 - System ID 9444
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 12:35:45 PM
Time spent in user mode 0 Days 00:02:00.125
Time spent in kernel mode 0 Days 00:04:21.828
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34
Back to Top
Thread 25 - System ID 8056
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 8/13/2012 12:35:57 PM
Time spent in user mode 0 Days 00:02:09.171
Time spent in kernel mode 0 Days 00:04:45.875
This thread is not fully resolved and may or may not be a problem. Further analysis of these threads may be required.
Function Source
ntdll!KiFastSystemCallRet
ntdll!NtClose+c
kernel32!FindClose+5c
php5ts!virtual_file_ex+73c
php5ts!php_stream_fopen+2c3
php5ts!php_stream_stat_path+112
php5ts!php_stat+234
Back to Top
Thread 26 - System ID 7948
Entry point ole32!CRpcThreadCache::RpcWorkerThreadEntry
Create time 8/13/2012 1:21:23 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwDelayExecution+c
kernel32!SleepEx+68
kernel32!Sleep+f
ole32!CROIDTable::WorkerThreadLoop+14
ole32!CRpcThread::WorkerLoop+26
ole32!CRpcThreadCache::RpcWorkerThreadEntry+20
kernel32!BaseThreadStart+34
Back to Top
Thread 27 - System ID 7876
Entry point ntdll!RtlpWorkerThread
Create time 8/13/2012 1:31:39 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00
Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
ntdll!RtlpWorkerThread+3d
kernel32!BaseThreadStart+34
Back to Top
HTTP report
IIS ATQ worker thread count 16 Thread(s)
Available ATQ worker thread count 8 Thread(s)
Active client connections 42 client connection(s)
Client Connections
Client connection from 107.7.21.162:53256 to x.x.x.x:80
Host Header xxxxxx.com:80
GET request for /wp-admin/wp-content/uploads/2011/06/xxx_thumbnail.jpg
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:30
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 14
Client connection from 107.7.21.162:53259 to x.x.x.x:80
Host Header xxxxxx.com:80
GET request for /wp-admin/wp-content/uploads/2011/06/xxx_thumbnail.jpg
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:19
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 22
Client connection from 107.7.21.162:53260 to x.x.x.x:80
Host Header xxxxxx.com:80
GET request for /wp-admin/wp-content/uploads/2011/06/xxx_thumbnail.jpg
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:17
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 13
Client connection from 107.7.21.162:53261 to x.x.x.x:80
Host Header xxxxxx.com:80
GET request for /wp-admin/wp-content/uploads/2011/06/xxx_thumbnail.jpg
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:17
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 17
Client connection from 91.201.64.223:4587 to x.x.x.x:80
Host Header www.xxxxxx.com:80
GET request for /Index.php
HTTP Version HTTP/1.0
SSL Request False
Time alive 00:00:49
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 19
Client connection from 107.7.21.162:53278 to x.x.x.x:80
Host Header xxxxxx.com:80
GET request for /wp-admin/wp-content/uploads/2011/06/xxx_thumbnail.jpg
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:00:44
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 4
Client connection from 213.186.122.2:43829 to x.x.x.x:80
Host Header www.xxxxxx.com:80
GET request for /do-i-release-my-medical-records-xxxxxxxxxxxxxxxxxxxx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:00:38
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 18
Client connection from 107.7.21.162:53282 to x.x.x.x:80
Host Header xxxxxx.com:80
GET request for /wp-admin/wp-content/uploads/2011/06/xxx_thumbnail.jpg
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:00:35
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS
Connection serviced by Thread 25
34 connection(s) waiting for the next request.
Script Summary
Script Name Status Error Code Error Source Error Description Source Line
CrashHangAnalysis.asp Completed