[ENBD] fr1 hangs when trying to access raid device..
Arve Emil Myrås
enbd@lists.community.tummy.com
Tue, 4 Feb 2003 19:35:45 +0100
>> This is the result form a test with "dd if=/dev/zero of=/dev/md0 =
bs=1024 count=200" on a no-smp kernel with smp disabled >in bios and the same loop setup as used earlyer..
>
>OK.
>
>> in the shell i get:
>>
>> 200+0 records in
>> 200+0 records out
>> Segmentation fault
>
>Well it segfaulted after finishing, so that must be in close!
>
>It's certainly curious. Can you do read? (we see above that writes have
>problems).
no.. it segfaults before the records in/out is written to shell..
.
>
>> and in syslog:
>
>You must pass this through ksymoops. The numbers are not meaningful in
>themselves. You have to translate the addresses to function names. =
Can
>you do that, please?
like this?? :
vserv:~ # ksymoops
ksymoops 2.4.5 on i686 2.4.20ctx-16nsmp. Options used
-V (default)
-k /proc/ksyms (default)
-l /proc/modules (default)
-o /lib/modules/2.4.20ctx-16nsmp/ (default)
-m /boot/System.map-2.4.20ctx-16nsmp (default)
Warning: You did not tell me where to find symbol information. I will
assume that the log matches the kernel and modules that are running
right now and I'll use the default options above for symbol resolution.
If the current kernel and/or modules do not match the log, you can get
more accurate output by telling me the kernel version and where to find
map, modules, ksyms etc. ksymoops -h explains the options.
Error (regular_file): read_system_map stat /boot/System.map-2.4.20ctx-16nsmp failed
ksymoops: No such file or directory
Reading Oops report from the terminal
Feb 4 17:20:56 vserv kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000010
Feb 4 17:20:56 vserv kernel: printing eip:
Feb 4 17:20:56 vserv kernel: fad24c08
Feb 4 17:20:56 vserv kernel: *pde = 00000000
Feb 4 17:20:56 vserv kernel: Oops: 0000
Feb 4 17:20:56 vserv kernel: CPU: 0
Feb 4 17:20:56 vserv kernel: EIP: 0010:[<fad24c08>] Not tainted
Feb 4 17:20:56 vserv kernel: EFLAGS: 00010046
Feb 4 17:20:56 vserv kernel: eax: 00000000 ebx: 00000000 ecx: c02e8b2c edx: c02e8b2c
Feb 4 17:20:56 vserv kernel: esi: c02e8b4c edi: c02e8b2c ebp: f5267d94 esp: f5267d7c
Feb 4 17:20:56 vserv kernel: ds: 0018 es: 0018 ss: 0018
Feb 4 17:20:56 vserv kernel: Process dd (pid: 973, stackpage=f5267000)
Feb 4 17:20:56 vserv kernel: Stack: 00000000 f60eb640 c02e8b4c 00000296 c02e8b4c f5266000 c02e8b2c c01a21e6
Feb 4 17:20:56 vserv kernel: c02e8b2c f5266000 c01a24dc c02e8b2c c01a26e8 00000000 f5266000 00000000
Feb 4 17:20:56 vserv kernel: 00000000 00000000 f5266000 00000000 00000000 00000001 c02e8b4c c02e8b4c
Feb 4 17:20:56 vserv kernel: Call Trace: [<c01a21e6>] [<c01a24dc>] [<c01a26e8>] [<c01a2be2>] [<c01a312e>]
Feb 4 17:20:56 vserv kernel: [<c01a31ed>] [<c013730c>] [<c01373e6>] [<c0137428>] [<c013750a>] [<c013c293>]
Feb 4 17:20:56 vserv kernel: [<c013cd08>] [<c0137032>] [<c013570d>] [<c013578e>] [<c0108eff>]
Feb 4 17:20:56 vserv kernel:
Feb 4 17:20:56 vserv kernel: Code: 8a 43 10 8b 34 85 00 85 d2 fa 85 f6 0f 84 b6 00 00 00 8b 06
Feb 4 17:20:56 vserv kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000010
Feb 4 17:20:56 vserv kernel: fad24c08
Feb 4 17:20:56 vserv kernel: *pde = 00000000
Feb 4 17:20:56 vserv kernel: Oops: 0000
Feb 4 17:20:56 vserv kernel: CPU: 0
Feb 4 17:20:56 vserv kernel: EIP: 0010:[<fad24c08>] Not tainted
Using defaults from ksymoops -t elf32-i386 -a i386
Feb 4 17:20:56 vserv kernel: EFLAGS: 00010046
Feb 4 17:20:56 vserv kernel: eax: 00000000 ebx: 00000000 ecx: c02e8b2c edx: c02e8b2c
Feb 4 17:20:56 vserv kernel: esi: c02e8b4c edi: c02e8b2c ebp: f5267d94 esp: f5267d7c
Feb 4 17:20:56 vserv kernel: ds: 0018 es: 0018 ss: 0018
Feb 4 17:20:56 vserv kernel: Process dd (pid: 973, stackpage=f5267000)
Feb 4 17:20:56 vserv kernel: Stack: 00000000 f60eb640 c02e8b4c 00000296 c02e8b4c f5266000 c02e8b2c c01a21e6
Feb 4 17:20:56 vserv kernel: c02e8b2c f5266000 c01a24dc c02e8b2c c01a26e8 00000000 f5266000 00000000
Feb 4 17:20:56 vserv kernel: 00000000 00000000 f5266000 00000000 00000000 00000001 c02e8b4c c02e8b4c
Feb 4 17:20:56 vserv kernel: Call Trace: [<c01a21e6>] [<c01a24dc>] [<c01a26e8>] [<c01a2be2>] [<c01a312e>]
Feb 4 17:20:56 vserv kernel: [<c01a31ed>] [<c013730c>] [<c01373e6>] [<c0137428>] [<c013750a>] [<c013c293>]
Feb 4 17:20:56 vserv kernel: [<c013cd08>] [<c0137032>] [<c013570d>] [<c013578e>] [<c0108eff>]
Feb 4 17:20:56 vserv kernel: Code: 8a 43 10 8b 34 85 00 85 d2 fa 85 f6 0f 84 b6 00 00 00 8b 06
>>EIP; fad24c08 <[fr1]do_fr1_request+28/130> <=====
>>ecx; c02e8b2c <blk_dev+4ec/8b80>
>>edx; c02e8b2c <blk_dev+4ec/8b80>
>>esi; c02e8b4c <blk_dev+50c/8b80>
>>edi; c02e8b2c <blk_dev+4ec/8b80>
>>ebp; f5267d94 <___strtok+34f68874/3a51fb40>
>>esp; f5267d7c <___strtok+34f6885c/3a51fb40>
Trace; c01a21e6 <generic_unplug_device+36/40>
Trace; c01a24dc <blk_init_queue+1ac/230>
Trace; c01a26e8 <set_device_ro+148/2b0>
Trace; c01a2be2 <blkdev_release_request+332/7a0>
Trace; c01a312e <generic_make_request+de/140>
Trace; c01a31ed <submit_bh+5d/80>
Trace; c013730c <__wait_on_buffer+ec/3d0>
Trace; c01373e6 <__wait_on_buffer+1c6/3d0>
Trace; c0137428 <__wait_on_buffer+208/3d0>
Trace; c013750a <__wait_on_buffer+2ea/3d0>
Trace; c013c293 <sb_min_blocksize+293/460>
Trace; c013cd08 <blkdev_put+c8/130>
Trace; c0137032 <fput+102/130>
Trace; c013570d <filp_close+4d/80>
Trace; c013578e <sys_close+4e/c0>
Trace; c0108eff <__up_wakeup+12bf/1690>
Code; fad24c08 <[fr1]do_fr1_request+28/130>
00000000 <_EIP>:
Code; fad24c08 <[fr1]do_fr1_request+28/130> <=====
0: 8a 43 10 mov 0x10(%ebx),%al <=====
Code; fad24c0b <[fr1]do_fr1_request+2b/130>
3: 8b 34 85 00 85 d2 fa mov 0xfad28500(,%eax,4),%esi
Code; fad24c12 <[fr1]do_fr1_request+32/130>
a: 85 f6 test %esi,%esi
Code; fad24c14 <[fr1]do_fr1_request+34/130>
c: 0f 84 b6 00 00 00 je c8 <_EIP+0xc8> fad24cd0 <[fr1]do_fr1_request+f0/130>
Code; fad24c1a <[fr1]do_fr1_request+3a/130>
12: 8b 06 mov (%esi),%eax
Feb 4 16:51:10 vserv kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000010
Feb 4 16:51:10 vserv kernel: printing eip:
Feb 4 16:51:10 vserv kernel: fae40c08
Feb 4 16:51:10 vserv kernel: *pde = 00000000
Feb 4 16:51:10 vserv kernel: Oops: 0000
Feb 4 16:51:10 vserv kernel: CPU: 0
Feb 4 16:51:10 vserv kernel: EIP: 0010:[<fae40c08>] Not tainted
Feb 4 16:51:10 vserv kernel: EFLAGS: 00010046
Feb 4 16:51:10 vserv kernel: eax: 00000000 ebx: 00000000 ecx: c02e8b2c edx: c02e8b2c
Feb 4 16:51:10 vserv kernel: esi: f62dfed0 edi: c02e8b2c ebp: f62dfeb8 esp: f62dfea0
Feb 4 16:51:10 vserv kernel: ds: 0018 es: 0018 ss: 0018
Feb 4 16:51:10 vserv kernel: Process mke2fs (pid: 986, stackpage=f62df000)
Feb 4 16:51:10 vserv kernel: Stack: c01a31ed 00000000 c02e8b4c 00000286 f62dfed0 c1c01148 f62dfef0 c01a21e6
Feb 4 16:51:10 vserv kernel: c02e8b2c f62dfed0 c011ad7d c02e8b2c c02e8b84 c02e8b84 c1a287b0 f62de000
Feb 4 16:51:10 vserv kernel: c013a7a1 c02852c0 c0127ba6 c1a287b0 00000000 f62de000 c1c01148 c1c01148
Feb 4 16:51:10 vserv kernel: Call Trace: [<c01a31ed>] [<c01a21e6>] [<c011ad7d>] [<c013a7a1>] [<c0127ba6>]
Feb 4 16:51:10 vserv kernel: [<c012843e>] [<c0128820>] [<c0128998>] [<c0128820>] [<c01360b3>] [<c0108eff>]
Feb 4 16:51:10 vserv kernel:
Feb 4 16:51:10 vserv kernel: Code: 8a 43 10 8b 34 85 00 45 e4 fa 85 f6 0f 84 b6 00 00 00 8b 06
Feb 4 16:51:10 vserv kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000010
Feb 4 16:51:10 vserv kernel: fae40c08
Feb 4 16:51:10 vserv kernel: *pde = 00000000
Feb 4 16:51:10 vserv kernel: Oops: 0000
Feb 4 16:51:10 vserv kernel: CPU: 0
Feb 4 16:51:10 vserv kernel: EIP: 0010:[<fae40c08>] Not tainted
Feb 4 16:51:10 vserv kernel: EFLAGS: 00010046
Feb 4 16:51:10 vserv kernel: eax: 00000000 ebx: 00000000 ecx: c02e8b2c edx: c02e8b2c
Feb 4 16:51:10 vserv kernel: esi: f62dfed0 edi: c02e8b2c ebp: f62dfeb8 esp: f62dfea0
Feb 4 16:51:10 vserv kernel: ds: 0018 es: 0018 ss: 0018
Feb 4 16:51:10 vserv kernel: Process mke2fs (pid: 986, stackpage=f62df000)
Feb 4 16:51:10 vserv kernel: Stack: c01a31ed 00000000 c02e8b4c 00000286 f62dfed0 c1c01148 f62dfef0 c01a21e6
Feb 4 16:51:10 vserv kernel: c02e8b2c f62dfed0 c011ad7d c02e8b2c c02e8b84 c02e8b84 c1a287b0 f62de000
Feb 4 16:51:10 vserv kernel: c013a7a1 c02852c0 c0127ba6 c1a287b0 00000000 f62de000 c1c01148 c1c01148
Feb 4 16:51:10 vserv kernel: Call Trace: [<c01a31ed>] [<c01a21e6>] [<c011ad7d>] [<c013a7a1>] [<c0127ba6>]
Feb 4 16:51:10 vserv kernel: [<c012843e>] [<c0128820>] [<c0128998>] [<c0128820>] [<c01360b3>] [<c0108eff>]
Feb 4 16:51:10 vserv kernel: Code: 8a 43 10 8b 34 85 00 45 e4 fa 85 f6 0f 84 b6 00 00 00 8b 06
>>EIP; fae40c08 <[e1000].data.end+47fbd/4d415> <=====
>>ecx; c02e8b2c <blk_dev+4ec/8b80>
>>edx; c02e8b2c <blk_dev+4ec/8b80>
>>esi; f62dfed0 <___strtok+35fe09b0/3a51fb40>
>>edi; c02e8b2c <blk_dev+4ec/8b80>
>>ebp; f62dfeb8 <___strtok+35fe0998/3a51fb40>
>>esp; f62dfea0 <___strtok+35fe0980/3a51fb40>
Trace; c01a31ed <submit_bh+5d/80>
Trace; c01a21e6 <generic_unplug_device+36/40>
Trace; c011ad7d <__run_task_queue+4d/120>
Trace; c013a7a1 <block_sync_page+21/2d0>
Trace; c0127ba6 <___wait_on_page+b6/c0>
Trace; c012843e <do_generic_file_read+2fe/7b0>
Trace; c0128820 <do_generic_file_read+6e0/7b0>
Trace; c0128998 <generic_file_read+a8/750>
Trace; c0128820 <do_generic_file_read+6e0/7b0>
Trace; c01360b3 <default_llseek+2a3/cb0>
Trace; c0108eff <__up_wakeup+12bf/1690>
Code; fae40c08 <[e1000].data.end+47fbd/4d415>
00000000 <_EIP>:
Code; fae40c08 <[e1000].data.end+47fbd/4d415> <=====
0: 8a 43 10 mov 0x10(%ebx),%al <=====
Code; fae40c0b <[e1000].data.end+47fc0/4d415>
3: 8b 34 85 00 45 e4 fa mov 0xfae44500(,%eax,4),%esi
Code; fae40c12 <[e1000].data.end+47fc7/4d415>
a: 85 f6 test %esi,%esi
Code; fae40c14 <[e1000].data.end+47fc9/4d415>
c: 0f 84 b6 00 00 00 je c8 <_EIP+0xc8> fae40cd0 <[e1000].data.end+48085/4d415>
Code; fae40c1a <[e1000].data.end+47fcf/4d415>
12: 8b 06 mov (%esi),%eax
and the output from read goes:
Feb 4 19:28:30 vserv kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000010
Feb 4 19:28:30 vserv kernel: printing eip:
Feb 4 19:28:30 vserv kernel: fad24c08
Feb 4 19:28:30 vserv kernel: *pde = 00000000
Feb 4 19:28:30 vserv kernel: Oops: 0000
Feb 4 19:28:30 vserv kernel: CPU: 0
Feb 4 19:28:30 vserv kernel: EIP: 0010:[<fad24c08>] Not tainted
Feb 4 19:28:30 vserv kernel: EFLAGS: 00010046
Feb 4 19:28:30 vserv kernel: eax: 00000000 ebx: 00000000 ecx: c02e8b2c edx: c02e8b2c
Feb 4 19:28:30 vserv kernel: esi: f4d07ed0 edi: c02e8b2c ebp: f4d07eb8 esp: f4d07ea0
Feb 4 19:28:30 vserv kernel: ds: 0018 es: 0018 ss: 0018
Feb 4 19:28:30 vserv kernel: Process dd (pid: 968, stackpage=f4d07000)
Feb 4 19:28:30 vserv kernel: Stack: c01a31ed 00000000 c02e8b4c 00000286 f4d07ed0 c1c00c28 f4d07ef0 c01a21e6
Feb 4 19:28:30 vserv kernel: c02e8b2c f4d07ed0 c011ad7d c02e8b2c c02e8b84 c02e8b84 c19e6120 f4d06000
Feb 4 19:28:30 vserv kernel: c013a7a1 c02852c0 c0127ba6 c19e6120 00000000 f4d06000 c1c00c28 c1c00c28
Feb 4 19:28:30 vserv kernel: Call Trace: [<c01a31ed>] [<c01a21e6>] [<c011ad7d>] [<c013a7a1>] [<c0127ba6>]
Feb 4 19:28:30 vserv kernel: [<c012843e>] [<c0128820>] [<c0128998>] [<c0128820>] [<c01360b3>] [<c0108eff>]
Feb 4 19:28:30 vserv kernel:
Feb 4 19:28:30 vserv kernel: Code: 8a 43 10 8b 34 85 00 85 d2 fa 85 f6 0f 84 b6 00 00 00 8b 06
Feb 4 19:28:30 vserv kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000010
Feb 4 19:28:30 vserv kernel: fad24c08
Feb 4 19:28:30 vserv kernel: *pde = 00000000
Feb 4 19:28:30 vserv kernel: Oops: 0000
Feb 4 19:28:30 vserv kernel: CPU: 0
Feb 4 19:28:30 vserv kernel: EIP: 0010:[<fad24c08>] Not tainted
Feb 4 19:28:30 vserv kernel: EFLAGS: 00010046
Feb 4 19:28:30 vserv kernel: eax: 00000000 ebx: 00000000 ecx: c02e8b2c edx: c02e8b2c
Feb 4 19:28:30 vserv kernel: esi: f4d07ed0 edi: c02e8b2c ebp: f4d07eb8 esp: f4d07ea0
Feb 4 19:28:30 vserv kernel: ds: 0018 es: 0018 ss: 0018
Feb 4 19:28:30 vserv kernel: Process dd (pid: 968, stackpage=f4d07000)
Feb 4 19:28:30 vserv kernel: Stack: c01a31ed 00000000 c02e8b4c 00000286 f4d07ed0 c1c00c28 f4d07ef0 c01a21e6
Feb 4 19:28:30 vserv kernel: c02e8b2c f4d07ed0 c011ad7d c02e8b2c c02e8b84 c02e8b84 c19e6120 f4d06000
Feb 4 19:28:30 vserv kernel: c013a7a1 c02852c0 c0127ba6 c19e6120 00000000 f4d06000 c1c00c28 c1c00c28
Feb 4 19:28:30 vserv kernel: Call Trace: [<c01a31ed>] [<c01a21e6>] [<c011ad7d>] [<c013a7a1>] [<c0127ba6>]
Feb 4 19:28:30 vserv kernel: [<c012843e>] [<c0128820>] [<c0128998>] [<c0128820>] [<c01360b3>] [<c0108eff>]
Feb 4 19:28:30 vserv kernel: Code: 8a 43 10 8b 34 85 00 85 d2 fa 85 f6 0f 84 b6 00 00 00 8b 06
>>EIP; fad24c08 <[fr1]do_fr1_request+28/130> <=====
>>ecx; c02e8b2c <blk_dev+4ec/8b80>
>>edx; c02e8b2c <blk_dev+4ec/8b80>
>>esi; f4d07ed0 <___strtok+34a089b0/3a51fb40>
>>edi; c02e8b2c <blk_dev+4ec/8b80>
>>ebp; f4d07eb8 <___strtok+34a08998/3a51fb40>
>>esp; f4d07ea0 <___strtok+34a08980/3a51fb40>
Trace; c01a31ed <submit_bh+5d/80>
Trace; c01a21e6 <generic_unplug_device+36/40>
Trace; c011ad7d <__run_task_queue+4d/120>
Trace; c013a7a1 <block_sync_page+21/2d0>
Trace; c0127ba6 <___wait_on_page+b6/c0>
Trace; c012843e <do_generic_file_read+2fe/7b0>
Trace; c0128820 <do_generic_file_read+6e0/7b0>
Trace; c0128998 <generic_file_read+a8/750>
Trace; c0128820 <do_generic_file_read+6e0/7b0>
Trace; c01360b3 <default_llseek+2a3/cb0>
Trace; c0108eff <__up_wakeup+12bf/1690>
Code; fad24c08 <[fr1]do_fr1_request+28/130>
00000000 <_EIP>:
Code; fad24c08 <[fr1]do_fr1_request+28/130> <=====
0: 8a 43 10 mov 0x10(%ebx),%al <=====
Code; fad24c0b <[fr1]do_fr1_request+2b/130>
3: 8b 34 85 00 85 d2 fa mov 0xfad28500(,%eax,4),%esi
Code; fad24c12 <[fr1]do_fr1_request+32/130>
a: 85 f6 test %esi,%esi
Code; fad24c14 <[fr1]do_fr1_request+34/130>
c: 0f 84 b6 00 00 00 je c8 <_EIP+0xc8> fad24cd0 <[fr1]do_fr1_request+f0/130>
Code; fad24c1a <[fr1]do_fr1_request+3a/130>
12: 8b 06 mov (%esi),%eax
hope this means more to you than (to me) the last one...
-Arve Emil