[Openswan Users] BUG: unable to handle kernel NULL pointer -- 2.6.33 w/ |KLIPS

Danilo Godec danilo.godec at agenda.si
Wed Jun 8 02:46:52 EDT 2011


On 06/04/2011 12:29 AM, Paul Wouters wrote:
>
> Is this with 2.6.34rc4?

No, this was OpenSwan 2.6.33, compiled as a SuSE RPM - there are *some*
SuSE patches, but they mostly deal with stuff like install paths and
permissions. I had similar problem with older OpenSwan versions (2.3.29,
...).

The same SRPMs work well when compiled on OpenSuSE 11.2 with 2.6.31.14
kernel.


  Danilo


>
> Paul
>
> On Fri, 3 Jun 2011, Danilo Godec wrote:
>
>> Date: Fri, 03 Jun 2011 12:53:22 +0200
>> From: Danilo Godec <danilo.godec at agenda.si>
>> To: users at openswan.org
>> Subject: Re: [Openswan Users] BUG: unable to handle kernel NULL
>> pointer --
>>     2.6.33 w/ |KLIPS
>>
>> Hi,
>>
>> I have a very similar issue on OpenSuSE 11.3 running 2.6.34.8 kernel. I
>> don't even need to have a connection defined - whenever I start OpenSWAN
>> (/etc/init.d/ipsec start), I get a similar kernel dump - whether I have
>> a connection defined or not.
>>
>> This is the output of 'dmesg' - before starting ipsec I cleared the
>> 'dmesg' buffer, so this is all produced by starting ipsec:
>>
>> [83785.444371] padlock: VIA PadLock not detected.
>> [83785.449897] padlock: VIA PadLock Hash Engine not detected.
>> [83785.455587] Intel AES-NI instructions are not detected.
>> [83785.465037] Intel AES-NI instructions are not detected.
>> [83785.469105] padlock: VIA PadLock not detected.
>> [83785.529690] klips_info:ipsec_init: KLIPS startup, Openswan KLIPS
>> IPsec stack version: 2.6.33
>> [83785.529782] NET: Registered protocol family 15
>> [83785.531018] registered KLIPS /proc/sys/net
>> [83785.531022] klips_info:ipsec_alg_init: KLIPS alg v=0.8.1-0
>> (EALG_MAX=255, AALG_MAX=251)
>> [83785.531024] klips_info:ipsec_alg_init: calling
>> ipsec_alg_static_init()
>> [83785.531028] ipsec_aes_init(alg_type=15 alg_id=12 name=aes): ret=0
>> [83785.531030] klips_debug: experimental ipsec_alg_AES_MAC not
>> registered [Ok] (auth_id=0)
>> [83785.531033] ipsec_3des_init(alg_type=15 alg_id=3 name=3des): ret=0
>> [83785.562825] general protection fault: 0000 [#1] PREEMPT SMP
>> [83785.562830] last sysfs file: /sys/devices/virtual/net/ipsec0/flags
>> [83785.562833] CPU 0
>> [83785.562835] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83785.562927]
>> [83785.562930] Pid: 23352, comm: klipsdebug Not tainted
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83785.562932] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.562945] RSP: 0018:ffff88002b0a1ec8  EFLAGS: 00010292
>> [83785.562947] RAX: 6265647370696c6b RBX: ffff8800a4a0b1c0 RCX:
>> 0000000000000000
>> [83785.562949] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83785.562952] RBP: ffff880068b28400 R08: 0000000000000000 R09:
>> ffff880068b28400
>> [83785.562954] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83785.562956] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff8800a4a0b1c0
>> [83785.562959] FS:  00007f83868e7700(0000) GS:ffff880001e00000(0000)
>> knlGS:0000000000000000
>> [83785.562961] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [83785.562963] CR2: 00007f838620d930 CR3: 0000000007c3c000 CR4:
>> 00000000000006f0
>> [83785.562966] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83785.562968] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83785.562971] Process klipsdebug (pid: 23352, threadinfo
>> ffff88002b0a0000, task ffff88002b0c0080)
>> [83785.562973] Stack:
>> [83785.562974]  000000000000000f ffff88002b0a1f70 0000000000000003
>> ffffffff813b0405
>> [83785.562978] <0> ffff880000000000 ffffffffa0b47a40 ffff88002b0a1f58
>> ffffffff814a7220
>> [83785.562981] <0> 00007fff64a73f60 0000000000000014 0000000000000001
>> 0000000000000003
>> [83785.562986] Call Trace:
>> [83785.563003]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83785.563003]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83785.563003]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83785.563003]  [<00007f838620d937>] 0x7f838620d937
>> [83785.563003] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83785.563003] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.563003]  RSP <ffff88002b0a1ec8>
>> [83785.563203] ---[ end trace 671e658752acda18 ]---
>> [83785.600171] BUG: unable to handle kernel paging request at
>> 00006574756f7269
>> [83785.600178] IP: [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.600191] PGD 0
>> [83785.600193] Oops: 0000 [#2] PREEMPT SMP
>> [83785.600196] last sysfs file: /sys/devices/virtual/net/mast0/flags
>> [83785.600200] CPU 0
>> [83785.600202] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83785.600293]
>> [83785.600296] Pid: 23370, comm: eroute Tainted: G      D
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83785.600298] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.600307] RSP: 0018:ffff880007d41ec8  EFLAGS: 00010292
>> [83785.600309] RAX: 00006574756f7265 RBX: ffff8800a4a0ba00 RCX:
>> 0000000000000000
>> [83785.600311] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83785.600313] RBP: ffff88004db21c00 R08: 0000000000000000 R09:
>> ffff88004db21c00
>> [83785.600315] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83785.600318] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff8800a4a0ba00
>> [83785.600320] FS:  00007f8271d81700(0000) GS:ffff880001e00000(0000)
>> knlGS:0000000000000000
>> [83785.600323] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [83785.600325] CR2: 00006574756f7269 CR3: 0000000007cde000 CR4:
>> 00000000000006f0
>> [83785.600327] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83785.600329] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83785.600332] Process eroute (pid: 23370, threadinfo ffff880007d40000,
>> task ffff880007c30900)
>> [83785.600334] Stack:
>> [83785.600335]  000000000000000f ffff880007d41f70 0000000000000003
>> ffffffff813b0405
>> [83785.600339] <0> ffff880000000000 ffffffffa0b47a40 ffff880007d41f58
>> ffffffff814a7220
>> [83785.600343] <0> 00007ffff555b100 0000000000000014 0000000000000001
>> 0000000000000003
>> [83785.600347] Call Trace:
>> [83785.600382]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83785.600389]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83785.600396]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83785.600403]  [<00007f82716a7937>] 0x7f82716a7937
>> [83785.600405] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83785.600436] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.600444]  RSP <ffff880007d41ec8>
>> [83785.600445] CR2: 00006574756f7269
>> [83785.600448] ---[ end trace 671e658752acda19 ]---
>> [83785.635785] BUG: unable to handle kernel paging request at
>> 0000000000697077
>> [83785.635792] IP: [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.635806] PGD 3edc9067 PUD aa9c8067 PMD 2b1e7067 PTE 0
>> [83785.635811] Oops: 0000 [#3] PREEMPT SMP
>> [83785.635814] last sysfs file: /sys/devices/virtual/net/mast0/flags
>> [83785.635818] CPU 0
>> [83785.635820] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83785.635916]
>> [83785.635919] Pid: 23377, comm: spi Tainted: G      D
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83785.635921] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.635931] RSP: 0018:ffff8800aa9c5ec8  EFLAGS: 00010292
>> [83785.635933] RAX: 0000000000697073 RBX: ffff88002e303940 RCX:
>> 0000000000000000
>> [83785.635935] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83785.635937] RBP: ffff88003ef7f400 R08: 0000000000000000 R09:
>> ffff88003ef7f400
>> [83785.635939] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83785.635941] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff88002e303940
>> [83785.635944] FS:  00007f6246078700(0000) GS:ffff880001e00000(0000)
>> knlGS:0000000000000000
>> [83785.635947] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> [83785.635949] CR2: 0000000000697077 CR3: 00000000aa9b7000 CR4:
>> 00000000000006f0
>> [83785.635951] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83785.635953] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83785.635956] Process spi (pid: 23377, threadinfo ffff8800aa9c4000,
>> task ffff88004dbf8180)
>> [83785.635958] Stack:
>> [83785.635959]  000000000000000f ffff8800aa9c5f70 0000000000000003
>> ffffffff813b0405
>> [83785.635963] <0> ffff880000000000 ffffffffa0b47a40 ffff8800aa9c5f58
>> ffffffff814a7220
>> [83785.635967] <0> 00007fff79359000 0000000000000014 0000000000000001
>> 0000000000000003
>> [83785.635971] Call Trace:
>> [83785.636004]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83785.636004]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83785.636004]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83785.636004]  [<00007f624599e937>] 0x7f624599e937
>> [83785.636004] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83785.636004] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.636004]  RSP <ffff8800aa9c5ec8>
>> [83785.636004] CR2: 0000000000697077
>> [83785.636446] ---[ end trace 671e658752acda1a ]---
>> [83785.682688] BUG: unable to handle kernel paging request at
>> 0000006766636e78
>> [83785.682694] IP: [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.682706] PGD 3ee8c067 PUD 0
>> [83785.682709] Oops: 0000 [#4] PREEMPT SMP
>> [83785.682713] last sysfs file: /sys/devices/virtual/net/mast0/flags
>> [83785.682716] CPU 0
>> [83785.682718] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83785.682808]
>> [83785.682811] Pid: 23383, comm: tncfg Tainted: G      D
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83785.682813] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.682822] RSP: 0018:ffff880007d41ec8  EFLAGS: 00010292
>> [83785.682824] RAX: 0000006766636e74 RBX: ffff88002e303100 RCX:
>> 0000000000000000
>> [83785.682826] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83785.682828] RBP: ffff880007d5b000 R08: 0000000000000000 R09:
>> ffff880007d5b000
>> [83785.682830] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83785.682832] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff88002e303100
>> [83785.682835] FS:  00007f4920ca6700(0000) GS:ffff880001e00000(0000)
>> knlGS:0000000000000000
>> [83785.682837] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> [83785.682840] CR2: 0000006766636e78 CR3: 000000003edc9000 CR4:
>> 00000000000006f0
>> [83785.682842] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83785.682844] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83785.682847] Process tncfg (pid: 23383, threadinfo ffff880007d40000,
>> task ffff88003ed480c0)
>> [83785.682848] Stack:
>> [83785.682850]  000000000000000f ffff880007d41f70 0000000000000003
>> ffffffff813b0405
>> [83785.682853] <0> ffff880000000000 ffffffffa0b47a40 ffff880007d41f58
>> ffffffff814a7220
>> [83785.682857] <0> ffff88003ed3c430 0000000000000014 0000000000013e40
>> 0000000000000003
>> [83785.682861] Call Trace:
>> [83785.682896]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83785.682903]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83785.682910]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83785.682917]  [<00007f49205cc937>] 0x7f49205cc937
>> [83785.682918] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83785.682949] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.682957]  RSP <ffff880007d41ec8>
>> [83785.682958] CR2: 0000006766636e78
>> [83785.683034] ---[ end trace 671e658752acda1b ]---
>> [83785.761429] BUG: unable to handle kernel paging request at
>> 0000006f74756c74
>> [83785.761434] IP: [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.761447] PGD 5f923067 PUD 0
>> [83785.761451] Oops: 0000 [#5] PREEMPT SMP
>> [83785.761454] last sysfs file: /sys/devices/virtual/net/mast0/flags
>> [83785.761458] CPU 1
>> [83785.761459] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83785.761554]
>> [83785.761557] Pid: 23421, comm: pluto Tainted: G      D
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83785.761559] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.761568] RSP: 0018:ffff880007d3fec8  EFLAGS: 00010292
>> [83785.761570] RAX: 0000006f74756c70 RBX: ffff8800ae3b5c40 RCX:
>> 0000000000000000
>> [83785.761573] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83785.761575] RBP: ffff88003efe3000 R08: 0000000000000000 R09:
>> ffff88003efe3000
>> [83785.761577] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83785.761579] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff8800ae3b5c40
>> [83785.761582] FS:  00007f7fc0d62700(0000) GS:ffff880001e80000(0000)
>> knlGS:0000000000000000
>> [83785.761584] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [83785.761587] CR2: 0000006f74756c74 CR3: 00000000ca94f000 CR4:
>> 00000000000006e0
>> [83785.761589] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83785.761591] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83785.761594] Process pluto (pid: 23421, threadinfo ffff880007d3e000,
>> task ffff88002b1b0280)
>> [83785.761596] Stack:
>> [83785.761597]  000000000000000f ffff880007d3ff70 0000000000000003
>> ffffffff813b0405
>> [83785.761601] <0> ffff880000000000 ffffffffa0b47a40 ffff880007d3ff58
>> ffffffff814a7220
>> [83785.761605] <0> 0000000000000000 0000000000000014 0000000000004000
>> 0000000000000003
>> [83785.761609] Call Trace:
>> [83785.761646]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83785.761654]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83785.761660]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83785.761668]  [<00007f7fc0688937>] 0x7f7fc0688937
>> [83785.761670] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83785.761701] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83785.761709]  RSP <ffff880007d3fec8>
>> [83785.761710] CR2: 0000006f74756c74
>> [83785.761713] ---[ end trace 671e658752acda1c ]---
>>
>>
>> If I try to stop ipsec, I get another dump (and it's repeatable):
>>
>>
>> [83941.466264] IPSEC EVENT: KLIPS device ipsec0 shut down.
>> [83941.476756] general protection fault: 0000 [#6] PREEMPT SMP
>> [83941.476762] last sysfs file:
>> /sys/devices/system/cpu/cpu1/cache/index2/shared_cpu_map
>> [83941.476766] CPU 1
>> [83941.476768] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83941.476885]
>> [83941.476889] Pid: 23597, comm: klipsdebug Tainted: G      D
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83941.476892] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.476908] RSP: 0018:ffff88000b889ec8  EFLAGS: 00010292
>> [83941.476911] RAX: 6265647370696c6b RBX: ffff88008cc5a480 RCX:
>> 0000000000000000
>> [83941.476914] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83941.476916] RBP: ffff88003ed61000 R08: 0000000000000000 R09:
>> ffff88003ed61000
>> [83941.476919] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83941.476922] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff88008cc5a480
>> [83941.476926] FS:  00007f0e51aec700(0000) GS:ffff880001e80000(0000)
>> knlGS:0000000000000000
>> [83941.476929] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [83941.476931] CR2: 00007f0e51412930 CR3: 000000000b81a000 CR4:
>> 00000000000006e0
>> [83941.476934] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83941.476937] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83941.476941] Process klipsdebug (pid: 23597, threadinfo
>> ffff88000b888000, task ffff88002b0b8880)
>> [83941.476943] Stack:
>> [83941.476945]  000000000000000f ffff88000b889f70 0000000000000003
>> ffffffff813b0405
>> [83941.476950] <0> ffff880000000000 ffffffffa0b47a40 ffff88000b889f58
>> ffffffff814a7220
>> [83941.476955] <0> 00007fff9f95c740 0000000000000014 0000000000000001
>> 0000000000000003
>> [83941.476961] Call Trace:
>> [83941.477002]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83941.477010]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83941.477018]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83941.477028]  [<00007f0e51412937>] 0x7f0e51412937
>> [83941.477030] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83941.477071] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.477081]  RSP <ffff88000b889ec8>
>> [83941.477085] ---[ end trace 671e658752acda1d ]---
>> [83941.480859] BUG: unable to handle kernel paging request at
>> 00006574756f7269
>> [83941.480866] IP: [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.480880] PGD 0
>> [83941.480883] Oops: 0000 [#7] PREEMPT SMP
>> [83941.480887] last sysfs file:
>> /sys/devices/system/cpu/cpu1/cache/index2/shared_cpu_map
>> [83941.480891] CPU 1
>> [83941.480893] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83941.481009]
>> [83941.481013] Pid: 23598, comm: eroute Tainted: G      D
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83941.481016] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.481027] RSP: 0018:ffff88002b003ec8  EFLAGS: 00010292
>> [83941.481030] RAX: 00006574756f7265 RBX: ffff88002e186d00 RCX:
>> 0000000000000000
>> [83941.481033] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83941.481036] RBP: ffff88003ef7e400 R08: 0000000000000000 R09:
>> ffff88003ef7e400
>> [83941.481039] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83941.481041] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff88002e186d00
>> [83941.481045] FS:  00007f54ff622700(0000) GS:ffff880001e80000(0000)
>> knlGS:0000000000000000
>> [83941.481048] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [83941.481051] CR2: 00006574756f7269 CR3: 00000000aa9f0000 CR4:
>> 00000000000006e0
>> [83941.481054] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83941.481057] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83941.481060] Process eroute (pid: 23598, threadinfo ffff88002b002000,
>> task ffff880007d6e800)
>> [83941.481062] Stack:
>> [83941.481064]  000000000000000f ffff88002b003f70 0000000000000003
>> ffffffff813b0405
>> [83941.481069] <0> ffff880000000000 ffffffffa0b47a40 ffff88002b003f58
>> ffffffff814a7220
>> [83941.481074] <0> 00007fffaa469d80 0000000000000014 0000000000000001
>> 0000000000000003
>> [83941.481080] Call Trace:
>> [83941.481114]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83941.481122]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83941.481127]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83941.481127]  [<00007f54fef48937>] 0x7f54fef48937
>> [83941.481127] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83941.481127] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.481127]  RSP <ffff88002b003ec8>
>> [83941.481127] CR2: 00006574756f7269
>> [83941.481608] ---[ end trace 671e658752acda1e ]---
>> [83941.486396] BUG: unable to handle kernel paging request at
>> 0000000000697077
>> [83941.486401] IP: [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.486414] PGD 2b0c1067 PUD 4da40067 PMD 3edc8067 PTE 0
>> [83941.486419] Oops: 0000 [#8] PREEMPT SMP
>> [83941.486422] last sysfs file:
>> /sys/devices/system/cpu/cpu1/cache/index2/shared_cpu_map
>> [83941.486426] CPU 1
>> [83941.486427] Modules linked in: ipsec af_packet authenc pppoe pppox
>> ppp_generic slhc rmd160 sha1_generic crypto_null camellia lzo
>> lzo_compress cast6 cast5 deflate zlib_deflate cts ctr gcm ccm serpent
>> blowfish twofish_x86_64 twofish_common xcbc cbc md5 sha256_generic
>> sha512_generic des_generic cryptd aes_x86_64 aes_generic tunnel4
>> xfrm_ipcomp tunnel6 tun vboxnetadp vboxnetflt radeon ttm drm_kms_helper
>> drm i2c_algo_bit vboxdrv snd_pcm_oss snd_mixer_oss snd_seq
>> snd_seq_device coretemp nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq
>> mperf iptable_filter ip_tables x_tables joydev edd fuse loop dm_mod
>> saa7134_alsa tda1004x saa7134_dvb videobuf_dvb dvb_core tda827x tda8290
>> tuner arc4 ecb snd_hda_codec_realtek firewire_ohci firewire_core
>> crc_itu_t snd_hda_intel saa7134 snd_hda_codec snd_hwdep ir_common
>> v4l2_common snd_pcm snd_timer ath5k snd mac80211 ath videodev
>> v4l1_compat v4l2_compat_ioctl32 videobuf_dma_sg ohci1394 sg sr_mod cdrom
>> soundcore usb_storage serio_raw pcspkr iTCO_wdt iTCO_vendor_support
>> videobuf_core ir_core tveeprom e100 cfg80211 rfkill ieee1394
>> snd_page_alloc i2c_i801 button intel_agp raid456 async_raid6_recov
>> async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid1 raid0
>> sd_mod ata_generic ata_piix fan processor ahci libata scsi_mod thermal
>> thermal_sys [last unloaded: af_key]
>> [83941.486518]
>> [83941.486521] Pid: 23599, comm: spi Tainted: G      D
>> 2.6.34.8-0.2-desktop #1 LEONITE/RZ484AA-ABF m8079.fr
>> [83941.486523] RIP: 0010:[<ffffffffa0b01310>]  [<ffffffffa0b01310>]
>> pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.486532] RSP: 0018:ffff88000b889ec8  EFLAGS: 00010292
>> [83941.486534] RAX: 0000000000697073 RBX: ffff8800a490a140 RCX:
>> 0000000000000000
>> [83941.486536] RDX: 000000000001e800 RSI: 7fffffffffffffff RDI:
>> 7fffffffffffffff
>> [83941.486538] RBP: ffff88005f8ef000 R08: 0000000000000000 R09:
>> ffff88005f8ef000
>> [83941.486541] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff81d91940
>> [83941.486543] R13: 0000000000000002 R14: ffffffff81d91940 R15:
>> ffff8800a490a140
>> [83941.486545] FS:  00007f260a1ba700(0000) GS:ffff880001e80000(0000)
>> knlGS:0000000000000000
>> [83941.486548] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [83941.486550] CR2: 0000000000697077 CR3: 000000000b81a000 CR4:
>> 00000000000006e0
>> [83941.486552] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [83941.486554] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [83941.486557] Process spi (pid: 23599, threadinfo ffff88000b888000,
>> task ffff88002b0b8880)
>> [83941.486559] Stack:
>> [83941.486560]  000000000000000f ffff88000b889f70 0000000000000003
>> ffffffff813b0405
>> [83941.486564] <0> ffff880000000000 ffffffffa0b47a40 ffff88000b889f58
>> ffffffff814a7220
>> [83941.486568] <0> 00007fff6a454900 0000000000000014 0000000000000001
>> 0000000000000003
>> [83941.486572] Call Trace:
>> [83941.486607]  [<ffffffff813b0405>] __sock_create+0x1c5/0x4a0
>> [83941.486613]  [<ffffffff813b0b9d>] sys_socket+0x2d/0x70
>> [83941.486620]  [<ffffffff81002ffb>] system_call_fastpath+0x16/0x1b
>> [83941.486627]  [<00007f2609ae0937>] 0x7f2609ae0937
>> [83941.486628] Code: 85 58 02 00 00 00 00 00 00 65 48 8b 04 25 40 b5 00
>> 00 48 c7 43 40 60 7a b4 a0 c6 45 49 02 66 c7 45 1c 0f 00 48 8b 80 80 04
>> 00 00 <8b> 40 04 89 85 98 01 00 00 44 8b 05 3c 9a 04 00 45 85 c0 0f 85
>> [83941.486659] RIP  [<ffffffffa0b01310>] pfkey_create+0xb0/0x2c0 [ipsec]
>> [83941.486667]  RSP <ffff88000b889ec8>
>> [83941.486669] CR2: 0000000000697077
>> [83941.486671] ---[ end trace 671e658752acda1f ]---
>>
>> and the 'ispec' module remains 'busy':
>>
>>> lsmod
>> Module                  Size  Used by
>> ipsec                 421054  16
>>
>>
>>
>>   Danilo
>>
>> _______________________________________________
>> Users at openswan.org
>> http://lists.openswan.org/mailman/listinfo/users
>> Micropayments: https://flattr.com/thing/38387/IPsec-for-Linux-made-easy
>> Building and Integrating Virtual Private Networks with Openswan:
>> http://www.amazon.com/gp/product/1904811256/104-3099591-2946327?n=283155
>>


-- 
Danilo Godec, sistemska podpora / system administration

Predlog! Obiscite prenovljeno spletno stran www.agenda.si 

ODPRTA KODA IN LINUX 
STORITVE : POSLOVNE RESITVE : UPRAVLJANJE IT : INFRASTRUKTURA IT : IZOBRAZEVANJE : PROGRAMSKA OPREMA 

Visit our updated web page at www.agenda.si 

OPEN SOURCE AND LINUX 
SERVICES : BUSINESS SOLUTIONS : IT MANAGEMENT : IT INFRASTRUCTURE : TRAINING : SOFTWARE 



More information about the Users mailing list