问题[segmentation-fault](server)

我正在尝试在 Apline Linux 上运行 Bacula（备份应用程序），并在通过bconsole连接到bacula-dir时出现分段错误。我尝试从另一台非 Alpine 服务器进行工作配置，从 Alpine latest-stable 和 Alpine edge 进行干净配置，但没有成功。

这正是带有回溯的错误输出

# /usr/sbin/bacula-dir -f -d 99 -m -T
bacula-dir: dird.c:219-0 Debug level = 99
Bacula interrupted by signal 11: Segmentation violation
Kaboom! bacula-dir, build-3-15-x86_64-dir got signal 11 - Segmentation violation at 03-Apr-2022 17:26:08. Attempting traceback.
Kaboom! exepath=/usr/sbin/
Calling: /usr/sbin/btraceback /usr/sbin/bacula-dir 2324 /var/lib/bacula
Segmentation fault
The btraceback call returned 139
LockDump: /var/lib/bacula/bacula.2324.traceback

 ==== Traceback output ====

[New LWP 2325]
[New LWP 2326]
[New LWP 2329]
0x00007fe3ebca3413 in ?? () from /lib/ld-musl-x86_64.so.1
#0  0x00007fe3ebca3413 in ?? () from /lib/ld-musl-x86_64.so.1
#1  0x00007fe3ebca072d in ?? () from /lib/ld-musl-x86_64.so.1
#2  0x00007fe3ebce4b84 in ?? () from /lib/ld-musl-x86_64.so.1
#3  0x0000000000000000 in ?? ()

Thread 4 (LWP 2329 "bacula-dir"):
#0  0x00007fe3ebca3413 in ?? () from /lib/ld-musl-x86_64.so.1
#1  0x00007fe3ebca072d in ?? () from /lib/ld-musl-x86_64.so.1
#2  0x00007fe3eb5a6b74 in ?? ()
#3  0x0000000000000000 in ?? ()

Thread 3 (LWP 2326 "bacula-dir"):
#0  0x00007fe3ebca3413 in ?? () from /lib/ld-musl-x86_64.so.1
#1  0x00007fe3ebca072d in ?? () from /lib/ld-musl-x86_64.so.1
#2  0x00007fe3eb5cdb74 in ?? ()
#3  0x0000000000000000 in ?? ()

Thread 2 (LWP 2325 "bacula-dir"):
#0  0x00007fe3ebca3413 in ?? () from /lib/ld-musl-x86_64.so.1
#1  0x00007fe3ebca072d in ?? () from /lib/ld-musl-x86_64.so.1
#2  0x00007fe3eb5f0b74 in ?? ()
#3  0x0000000000000000 in ?? ()

Thread 1 (LWP 2324 "bacula-dir"):
#0  0x00007fe3ebca3413 in ?? () from /lib/ld-musl-x86_64.so.1
#1  0x00007fe3ebca072d in ?? () from /lib/ld-musl-x86_64.so.1
#2  0x00007fe3ebce4b84 in ?? () from /lib/ld-musl-x86_64.so.1
#3  0x0000000000000000 in ?? ()
#0  0x00007fe3ebca3413 in ?? () from /lib/ld-musl-x86_64.so.1
No symbol table info available.
#1  0x00007fe3ebca072d in ?? () from /lib/ld-musl-x86_64.so.1
No symbol table info available.
#2  0x00007fe3ebce4b84 in ?? () from /lib/ld-musl-x86_64.so.1
No symbol table info available.
#3  0x0000000000000000 in ?? ()
No symbol table info available.
[Inferior 1 (process 2324) detached]
Attempt to dump current JCRs. njcrs=1
threadid=0x7fe3ebce4b48 JobId=0 JobStatus=R jcr=0x7fe3eb608318 name=*JobMonitor*.2022-04-03_17.26.05_01
        use_count=1 killable=0
        JobType=I JobLevel=
        sched_time=03-Apr-2022 17:26 start_time=03-Apr-2022 17:26
        end_time=01-Jan-1970 03:00 wait_time=01-Jan-1970 03:00
        db=0 db_batch=0 batch_started=0
        wstore=0x7fe3ebc04c58 rstore=0 wjcr=0 client=0x7fe3ebc04ac8 reschedule_count=0 SD_msg_chan_started=0
List plugins. Hook count=0
 ==== End traceback output ====

Segmentation fault

我有一个不断崩溃的 PostgreSQL 13 实例：

LOG:  server process (PID 10722) was terminated by signal 11: Segmentation fault
DETAIL:  Failed process was running: COMMIT
LOG:  terminating any other active server processes
WARNING:  terminating connection because of crash of another server process
DETAIL:  The postmaster has commanded this server process to roll back the current transaction and exit, because another server process exited abnormally and possibly corrupted shared memory.

我已更新/etc/postgresql/13/main/pg_ctl.conf以包含核心转储

pg_ctl_options = '--core-files'

并重新启动postgresql服务。现在它似乎允许核心转储：

$ for f in `pgrep postgres`; do cat /proc/$f/limits | grep core; done
Max core file size        unlimited            unlimited            bytes 

gdb回溯给出以下输出

$ gdb /usr/lib/postgresql/13/bin/postgres 13/main/core.postgres.12264

Program terminated with signal SIGSEGV, Segmentation fault.
#0  slot_deform_heap_tuple (natts=5, offp=0x557cc2e60720, tuple=<optimized out>, slot=0x557cc2e606d8) at ./build/../src/backend/executor/execTuples.c:930
930     ./build/../src/backend/executor/execTuples.c: No such file or directory.
(gdb) bt
#0  slot_deform_heap_tuple (natts=5, offp=0x557cc2e60720, tuple=<optimized out>, slot=0x557cc2e606d8) at ./build/../src/backend/executor/execTuples.c:930
#1  tts_buffer_heap_getsomeattrs (slot=0x557cc2e606d8, natts=5) at ./build/../src/backend/executor/execTuples.c:695
#2  0x0000557cc1d3998c in slot_getsomeattrs_int (slot=slot@entry=0x557cc2e606d8, attnum=5) at ./build/../src/backend/executor/execTuples.c:1912
#3  0x0000557cc1d28fba in slot_getsomeattrs (attnum=<optimized out>, slot=0x557cc2e606d8) at ./build/../src/include/executor/tuptable.h:344
#4  ExecInterpExpr (state=0x557cc2e620a8, econtext=0x557cc2ea1768, isnull=<optimized out>) at ./build/../src/backend/executor/execExprInterp.c:482
#5  0x0000557cc1d5548d in ExecEvalExprSwitchContext (isNull=0x7ffdd2599507, econtext=0x557cc2ea1768, state=0x557cc2e620a8) at ./build/../src/include/executor/executor.h:322
#6  ExecQual (econtext=0x557cc2ea1768, state=0x557cc2e620a8) at ./build/../src/include/executor/executor.h:391
#7  MJFillInner (node=0x557cc2ea1558) at ./build/../src/backend/executor/nodeMergejoin.c:494
#8  0x0000557cc1d55ce8 in ExecMergeJoin (pstate=0x557cc2ea1558) at ./build/../src/backend/executor/nodeMergejoin.c:1353
#9  0x0000557cc1d2cc83 in ExecProcNode (node=0x557cc2ea1558) at ./build/../src/include/executor/executor.h:248
#10 ExecutePlan (execute_once=<optimized out>, dest=0x557cc2e1a630, direction=<optimized out>, numberTuples=0, sendTuples=<optimized out>, operation=CMD_SELECT, use_parallel_mode=<optimized out>, planstate=0x557cc2ea1558, 
    estate=0x557cc2ea12f8) at ./build/../src/backend/executor/execMain.c:1632
#11 standard_ExecutorRun (queryDesc=0x557cc2e1a5a0, direction=<optimized out>, count=0, execute_once=<optimized out>) at ./build/../src/backend/executor/execMain.c:350
#12 0x00007f0ec05ae09d in pgss_ExecutorRun (queryDesc=0x557cc2e1a5a0, direction=ForwardScanDirection, count=0, execute_once=<optimized out>) at ./build/../contrib/pg_stat_statements/pg_stat_statements.c:1045
#13 0x0000557cc1cdbcd4 in PersistHoldablePortal (portal=portal@entry=0x557cc2d44b78) at ./build/../src/backend/commands/portalcmds.c:407
#14 0x0000557cc1ff95f9 in HoldPortal (portal=portal@entry=0x557cc2d44b78) at ./build/../src/backend/utils/mmgr/portalmem.c:642
#15 0x0000557cc1ff9e7d in PreCommit_Portals (isPrepare=isPrepare@entry=false) at ./build/../src/backend/utils/mmgr/portalmem.c:738
#16 0x0000557cc1c001c4 in CommitTransaction () at ./build/../src/backend/access/transam/xact.c:2087
#17 0x0000557cc1c015d5 in CommitTransactionCommand () at ./build/../src/backend/access/transam/xact.c:3085
#18 0x0000557cc1ea211d in finish_xact_command () at ./build/../src/backend/tcop/postgres.c:2662
#19 0x0000557cc1ea4703 in exec_simple_query (query_string=0x557cc2c9cd28 "COMMIT") at ./build/../src/backend/tcop/postgres.c:1264
#20 0x0000557cc1ea6143 in PostgresMain (argc=<optimized out>, argv=argv@entry=0x557cc2cf6c68, dbname=<optimized out>, username=<optimized out>) at ./build/../src/backend/tcop/postgres.c:4339
#21 0x0000557cc1e25bcd in BackendRun (port=0x557cc2ce94d0, port=0x557cc2ce94d0) at ./build/../src/backend/postmaster/postmaster.c:4526
#22 BackendStartup (port=0x557cc2ce94d0) at ./build/../src/backend/postmaster/postmaster.c:4210
#23 ServerLoop () at ./build/../src/backend/postmaster/postmaster.c:1739
#24 0x0000557cc1e26b41 in PostmasterMain (argc=5, argv=<optimized out>) at ./build/../src/backend/postmaster/postmaster.c:1412
#25 0x0000557cc1b70f4f in main (argc=5, argv=0x557cc2c96c30) at ./build/../src/backend/main/main.c:210

添加log_statement = 'all'到/etc/postgresql/13/main/postgresql.conf并没有真正的帮助，因为postmaster会立即终止所有进程并且查询不会写入日志。

这是strace运行后的输出COMMIT

[pid 20006] pwrite64(29, "COMMIT", 6, 15936) = 6
[pid 20006] pwrite64(29, "\0", 1, 15942) = 1
[pid 20006] close(29)                   = 0
[pid 20006] --- SIGSEGV {si_signo=SIGSEGV, si_code=SEGV_MAPERR, si_addr=0x10} ---
[pid 20006] +++ killed by SIGSEGV (core dumped) +++
<... select resumed> )                  = ? ERESTARTNOHAND (To be restarted if no handler)
--- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_DUMPED, si_pid=20006, si_uid=108, si_status=SIGSEGV, si_utime=0, si_stime=0} ---
wait4(-1, [{WIFSIGNALED(s) && WTERMSIG(s) == SIGSEGV && WCOREDUMP(s)}], WNOHANG, NULL) = 20006
write(2, "2021-09-08 13:38:51.853 UTC [299"..., 198) = 198
write(2, "2021-09-08 13:38:51.853 UTC [299"..., 88) = 88
kill(19324, SIGQUIT)                    = 0
kill(-19324, SIGQUIT)                   = 0
kill(19331, SIGQUIT)                    = 0
kill(-19331, SIGQUIT)                   = 0
kill(19320, SIGQUIT)                    = 0
kill(-19320, SIGQUIT)                   = 0
kill(19319, SIGQUIT)                    = 0
kill(-19319, SIGQUIT)                   = 0
kill(19321, SIGQUIT)                    = 0
kill(-19321, SIGQUIT)                   = 0
kill(19322, SIGQUIT)                    = 0
kill(-19322, SIGQUIT)                   = 0
kill(19323, SIGQUIT)                    = 0
kill(-19323, SIGQUIT)                   = 0
wait4(-1, 0x7ffe90814374, WNOHANG, NULL) = 0
rt_sigreturn({mask=[]})                 = -1 EINTR (Interrupted system call)
rt_sigprocmask(SIG_SETMASK, ~[ILL TRAP ABRT BUS FPE SEGV CONT SYS RTMIN RT_1], NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
select(7, [5 6], NULL, NULL, {tv_sec=5, tv_usec=0}) = ? ERESTARTNOHAND (To be restarted if no handler)
--- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=19320, si_uid=108, si_status=2, si_utime=14, si_stime=3} ---

有没有办法追溯执行的确切 SQL 查询？

所以我们在办公室使用 pvmove 进行了迁移。然后这件事发生了

Mar  8 12:26:51 v1 kernel: [ 5798.100321] BUG: kernel NULL pointer dereference, address: 0000000000000140
Mar  8 12:26:51 v1 kernel: [ 5798.101099] #PF: supervisor read access in kernel mode
Mar  8 12:26:51 v1 kernel: [ 5798.101716] #PF: error_code(0x0000) - not-present page
Mar  8 12:26:51 v1 kernel: [ 5798.102310] PGD 0 P4D 0 
Mar  8 12:26:51 v1 kernel: [ 5798.102904] Oops: 0000 [#1] SMP NOPTI
Mar  8 12:26:51 v1 kernel: [ 5798.103465] CPU: 48 PID: 1190 Comm: kworker/48:1H Not tainted 5.5.8-050508-generic #202003051633
Mar  8 12:26:51 v1 kernel: [ 5798.104071] Hardware name: ASUSTeK COMPUTER INC. RS700A-E9-RS12/KNPP-D32 Series, BIOS 1301 06/17/2019
Mar  8 12:26:51 v1 kernel: [ 5798.104693] Workqueue: kblockd blk_mq_run_work_fn
Mar  8 12:26:51 v1 kernel: [ 5798.105315] RIP: 0010:blk_mq_get_driver_tag+0x61/0x100
Mar  8 12:26:51 v1 kernel: [ 5798.105931] Code: 00 00 48 89 45 c0 8b 47 18 48 8b 7f 10 48 c7 45 d8 00 00 00 00 89 45 d0 b8 01 00 00 00 c7 45 c8 01 00 00 00 48 89 7d e0 75 50 <48> 8b 87 40 01 00 00 8b 40 04 39 43 24 73 07 c7 45 c8 03 00 00 00
Mar  8 12:26:51 v1 kernel: [ 5798.106653] RSP: 0018:ffffa92b9c59bcc0 EFLAGS: 00010246
Mar  8 12:26:51 v1 kernel: [ 5798.107371] RAX: 0000000000000001 RBX: ffff8d9b04805a00 RCX: ffffa92b9c59bda0
Mar  8 12:26:51 v1 kernel: [ 5798.108146] RDX: 0000000000000001 RSI: ffffa92b9c59bda0 RDI: 0000000000000000
Mar  8 12:26:51 v1 kernel: [ 5798.108881] RBP: ffffa92b9c59bd00 R08: 0000000000000000 R09: ffff8d9b04805ee8
Mar  8 12:26:51 v1 kernel: [ 5798.109613] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8d9b04805a00
Mar  8 12:26:51 v1 kernel: [ 5798.110397] R13: ffffa92b9c59bda0 R14: ffff8d9b04805a48 R15: 0000000000000000
Mar  8 12:26:51 v1 kernel: [ 5798.111167] FS:  0000000000000000(0000) GS:ffff8d9b1ef80000(0000) knlGS:0000000000000000
Mar  8 12:26:51 v1 kernel: [ 5798.111938] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar  8 12:26:51 v1 kernel: [ 5798.112693] CR2: 0000000000000140 CR3: 000000a7875fc000 CR4: 00000000003406e0
Mar  8 12:26:51 v1 kernel: [ 5798.113553] Call Trace:
Mar  8 12:26:51 v1 kernel: [ 5798.114351]  blk_mq_dispatch_rq_list+0xf9/0x550
Mar  8 12:26:51 v1 kernel: [ 5798.115121]  ? deadline_remove_request+0x4e/0xb0
Mar  8 12:26:51 v1 kernel: [ 5798.115862]  ? dd_dispatch_request+0x63/0x1f0
Mar  8 12:26:51 v1 kernel: [ 5798.116637]  blk_mq_do_dispatch_sched+0x67/0x100
Mar  8 12:26:51 v1 kernel: [ 5798.117404]  blk_mq_sched_dispatch_requests+0x12d/0x180
Mar  8 12:26:51 v1 kernel: [ 5798.118178]  __blk_mq_run_hw_queue+0x5a/0x110
Mar  8 12:26:51 v1 kernel: [ 5798.118944]  blk_mq_run_work_fn+0x1b/0x20
Mar  8 12:26:51 v1 kernel: [ 5798.119741]  process_one_work+0x1eb/0x3b0
Mar  8 12:26:51 v1 kernel: [ 5798.120534]  worker_thread+0x4d/0x400
Mar  8 12:26:51 v1 kernel: [ 5798.121369]  kthread+0x104/0x140
Mar  8 12:26:51 v1 kernel: [ 5798.122156]  ? process_one_work+0x3b0/0x3b0
Mar  8 12:26:51 v1 kernel: [ 5798.122960]  ? kthread_park+0x90/0x90
Mar  8 12:26:51 v1 kernel: [ 5798.123741]  ret_from_fork+0x22/0x40
Mar  8 12:26:51 v1 kernel: [ 5798.124524] Modules linked in: act_police cls_u32 sch_ingress sch_sfq sch_htb nls_utf8 isofs uas usb_storage xt_socket nf_socket_ipv4 nf_socket_ipv6 nf_defrag_ipv6 nf_defrag_ipv4 xt_mark iptable_mangle ebt_ip6 ebt_arp ebt_ip ebtable_broute ebtable_nat ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables bpfilter binfmt_misc dm_mirror dm_region_hash dm_log dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio input_leds ipmi_ssif amd64_edac_mod edac_mce_amd i2c_piix4 k10temp ipmi_si ipmi_devintf ipmi_msghandler mac_hid kvm_amd ccp kvm ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vhost_net vhost tap bonding lp parport br_netfilter bridge stp llc autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq multipath linear ast drm_vram_helper drm_ttm_helper ttm raid1 hid_generic raid0 drm_kms_helper usbhid crct10dif_pclmul syscopyarea crc32_pclmul
Mar  8 12:26:51 v1 kernel: [ 5798.124577]  bnx2x sysfillrect ghash_clmulni_intel sysimgblt fb_sys_fops aesni_intel crypto_simd mdio cryptd igb ahci hid glue_helper nvme libcrc32c drm dca libahci nvme_core i2c_algo_bit
Mar  8 12:26:51 v1 kernel: [ 5798.130380] CR2: 0000000000000140
Mar  8 12:26:51 v1 kernel: [ 5798.131449] ---[ end trace 2451c5dc4d61723b ]---
Mar  8 12:26:51 v1 kernel: [ 5798.246646] RIP: 0010:blk_mq_get_driver_tag+0x61/0x100
Mar  8 12:26:51 v1 kernel: [ 5798.248626] Code: 00 00 48 89 45 c0 8b 47 18 48 8b 7f 10 48 c7 45 d8 00 00 00 00 89 45 d0 b8 01 00 00 00 c7 45 c8 01 00 00 00 48 89 7d e0 75 50 <48> 8b 87 40 01 00 00 8b 40 04 39 43 24 73 07 c7 45 c8 03 00 00 00
Mar  8 12:26:51 v1 kernel: [ 5798.250301] RSP: 0018:ffffa92b9c59bcc0 EFLAGS: 00010246
Mar  8 12:26:51 v1 kernel: [ 5798.251725] RAX: 0000000000000001 RBX: ffff8d9b04805a00 RCX: ffffa92b9c59bda0
Mar  8 12:26:51 v1 kernel: [ 5798.253111] RDX: 0000000000000001 RSI: ffffa92b9c59bda0 RDI: 0000000000000000
Mar  8 12:26:51 v1 kernel: [ 5798.254411] RBP: ffffa92b9c59bd00 R08: 0000000000000000 R09: ffff8d9b04805ee8
Mar  8 12:26:51 v1 kernel: [ 5798.255695] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8d9b04805a00
Mar  8 12:26:51 v1 kernel: [ 5798.256925] R13: ffffa92b9c59bda0 R14: ffff8d9b04805a48 R15: 0000000000000000
Mar  8 12:26:51 v1 kernel: [ 5798.258145] FS:  0000000000000000(0000) GS:ffff8d9b1ef80000(0000) knlGS:0000000000000000
Mar  8 12:26:51 v1 kernel: [ 5798.259333] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar  8 12:26:51 v1 kernel: [ 5798.260587] CR2: 0000000000000140 CR3: 000000a7875fc000 CR4: 00000000003406e0

目前既不 abort 工作也不继续：

# pvmove --abort
    Failed to copy one or more poll_operation_id members.

# pvmove --atomic /dev/nvme3n1 /dev/md127
 Detected pvmove in progress for /dev/nvme3n1
 Ignoring remaining command line arguments
 ABORTING: Mirror percentage check failed.

我们成功删除了“pvmove0_mimage_0”以继续尝试 - 它仍然无法正常工作。

  LV                                        VG      Attr       LSize   Pool  Origin Data%  Meta%        Move Log Cpy%Sync Convert Devices          
    Intel                                     vgnvme0 twi-aotz--   3.64t              90.90  12.86                                  Intel_tdata(0)   
    [Intel_tdata]                             vgnvme0 TwI-ao----   3.64t                                                            /dev/md127(78)   
    [Intel_tdata]                             vgnvme0 TwI-ao----   3.64t                                                            pvmove0(0)       
    [Intel_tmeta]                             vgnvme0 ewI-ao---- 900.00m                                                            /dev/md127(0)    
    [Intel_tmeta]                             vgnvme0 ewI-ao---- 900.00m                                                            pvmove0(0)       
    [Intel_tmeta]                             vgnvme0 ewI-ao---- 900.00m                                                            pvmove0(0)       
    [lvol0_pmspare]                           vgnvme0 ewI-a----- 324.00m                                                            pvmove0(0)       
    [pvmove0]                                 vgnvme0 p-C-aom---   1.82t                                                            /dev/nvme3n1(0)  
    [pvmove0]                                 vgnvme0 p-C-aom---   1.82t                                                            /dev/nvme3n1(84) 
    [pvmove0]                                 vgnvme0 p-C-aom---   1.82t                                                            /dev/nvme3n1(228)
    [pvmove0]                                 vgnvme0 p-C-aom---   1.82t                                                            /dev/nvme3n1(3) 

系统正在运行，我们看到 vgnvme0-pvmove0 的一些用法（很可能是因为它是一个镜像），但是在这种情况下我们如何中止 pvmove？这是一些非常绝对无证的事情。我们不想重新映像备份，因为在迁移的 3 小时内已经有新内容写入。

当前的恢复建议是创建一个新的精简池，逐个卷迁移到它，停止运行虚拟机，更改软件数据库以适应新位置并重新启动虚拟机......并在完全成功迁移后删除旧的精简池。好像没有办法制作个人瘦lvs的镜像，可以吗？如果我们可以镜像单个 LV，我们可以毫无问题地迁移所有薄层我们有 lvs，例如 vm1 vm2 vm3 等...

我的 apache error.log 有很多段错误：

[core:notice] [pid 16753] AH00052: child pid 4861 exit signal Segmentation fault (11)

还有一些 glibc 每 10 小时左右检测一次错误：

*** glibc detected *** /usr/sbin/httpd: malloc(): corrupted unsorted chunks 2: 0x00007fcfcde5fd80 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x75dee)[0x7fcfcb7f1dee]
/lib64/libc.so.6(+0x7a4b8)[0x7fcfcb7f64b8]
/lib64/libc.so.6(__libc_malloc+0x5c)[0x7fcfcb7f6aac]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x104f5f)[0x7fcfc2a14f5f]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0xd6506)[0x7fcfc29e6506]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0xd8352)[0x7fcfc29e8352]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x74e82)[0x7fcfc2984e82]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(compile_filename+0xae)[0x7fcfc4faa6de]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x72e76)[0x7fcfc2982e76]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x71179)[0x7fcfc2981179]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x714ff)[0x7fcfc29814ff]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(zend_call_function+0x9b0)[0x7fcfc4fcd800]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(zend_call_method+0x1c7)[0x7fcfc4ff3a07]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(+0x18c116)[0x7fcfc4ee4116]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(zend_call_function+0x929)[0x7fcfc4fcd779]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(zend_lookup_class_ex+0x255)[0x7fcfc4fcdd25]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x99b95)[0x7fcfc29a9b95]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x71179)[0x7fcfc2981179]
/opt/cpanel/ea-php56/root/usr/lib64/php/modules/ioncube_loader_lin_5.6.so(+0x714ff)[0x7fcfc29814ff]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(zend_execute_scripts+0x18c)[0x7fcfc4fda53c]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(php_execute_script+0x2aa)[0x7fcfc4f7839a]
/opt/cpanel/ea-php56/root/usr/lib64/apache2/modules/libphp5.so(+0x329c45)[0x7fcfc5081c45]
/usr/sbin/httpd(ap_run_handler+0x40)[0x7fcfcd012b90]
/usr/sbin/httpd(ap_invoke_handler+0xce)[0x7fcfcd01704e]
/usr/sbin/httpd(ap_process_async_request+0x3fa)[0x7fcfcd02b7ea]
/usr/sbin/httpd(ap_process_request+0x1f)[0x7fcfcd02b94f]
/usr/sbin/httpd(+0x5c7c5)[0x7fcfcd0277c5]
/usr/sbin/httpd(ap_run_process_connection+0x40)[0x7fcfcd01e250]
/etc/apache2/modules/mod_mpm_prefork.so(+0x3ae4)[0x7fcfcaf6cae4]
/etc/apache2/modules/mod_mpm_prefork.so(+0x3d1e)[0x7fcfcaf6cd1e]
/etc/apache2/modules/mod_mpm_prefork.so(+0x4775)[0x7fcfcaf6d775]
/usr/sbin/httpd(ap_run_mpm+0x4e)[0x7fcfccff3cce]
/usr/sbin/httpd(main+0xbc1)[0x7fcfccfecfc1]
/lib64/libc.so.6(__libc_start_main+0xfd)[0x7fcfcb79ad1d]
/usr/sbin/httpd(+0x205c9)[0x7fcfccfeb5c9]

阿帕奇版本：

Server version: Apache/2.4.27 (cPanel)

php版本：

ea-php-cli Copyright 2017 cPanel, Inc.
PHP 5.6.31 (cli) (built: Aug 17 2017 01:08:43)
Copyright (c) 1997-2016 The PHP Group
Zend Engine v2.6.0, Copyright (c) 1998-2016 Zend Technologies
    with the ionCube PHP Loader (enabled) + Intrusion Protection from ioncube24.com (unconfigured) v6.1.0 (), Copyright (c) 2002-2017, by ionCube Ltd.
    with Zend Guard Loader v3.3, Copyright (c) 1998-2014, by Zend Technologies
    with Zend OPcache v7.0.4-dev, Copyright (c) 1999-2015, by Zend Technologies

我正在使用 prefork 运行 DSO 处理程序（CGI），并且我有以下 apache 模块：

Loaded Modules:
 core_module (static)
 so_module (static)
 http_module (static)
 mpm_prefork_module (shared)
 cgi_module (shared)
 access_compat_module (shared)
 actions_module (shared)
 alias_module (shared)
 asis_module (shared)
 auth_basic_module (shared)
 authn_core_module (shared)
 authn_file_module (shared)
 authz_core_module (shared)
 authz_groupfile_module (shared)
 authz_host_module (shared)
 authz_user_module (shared)
 autoindex_module (shared)
 deflate_module (shared)
 dir_module (shared)
 env_module (shared)
 expires_module (shared)
 filter_module (shared)
 headers_module (shared)
 imagemap_module (shared)
 include_module (shared)
 log_config_module (shared)
 logio_module (shared)
 mime_module (shared)
 negotiation_module (shared)
 proxy_module (shared)
 proxy_fcgi_module (shared)
 proxy_http_module (shared)
 proxy_wstunnel_module (shared)
 rewrite_module (shared)
 setenvif_module (shared)
 slotmem_shm_module (shared)
 socache_dbm_module (shared)
 socache_shmcb_module (shared)
 status_module (shared)
 suexec_module (shared)
 unique_id_module (shared)
 unixd_module (shared)
 userdir_module (shared)
 ssl_module (shared)
 bwlimited_module (shared)
 auth_token_module (shared)
 flvx_module (shared)
 php5_module (shared)
 h264_streaming_module (shared)

什么会导致我的错误？

我的服务器突然宕机，ISP 支持说它可能有分段错误。我想知道如何追踪并可能解决此问题，以免再次发生？

谢谢

可能重复：
我的服务器被黑了紧急情况

我们有一台运行 Ubuntu 11.10 的生产服务器。我们遇到了在各种条件下出现的段错误。最简单的可重现案例是当我们以管理用户身份登录 ssh 会话并输入虚假命令时。您会期待标准的“找不到命令”错误消息。相反，我们在 python 中遇到了段错误。用户的默认 shell 是 /bin/bash。

例如：

$ asdf
Segmentation fault

Info from /var/log/syslog:
Jul  6 15:39:20 PROD001 kernel: [2155960.605695] python[7873]: segfault at 0 ip (null) sp 00007fffd030b808 error 14 in python2.7[400000+233000]

服务器的一些细节：

$ uname -a
Linux PROD001 3.0.0-16-server #29-Ubuntu SMP Tue Feb 14 13:08:12 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux

$ cat /etc/issue
Ubuntu 11.10 \n \l

在我们要求 IT 部门重新安装操作系统之前，我想了解是什么让我们来到这里。系统和/或该特定用户的环境可疑。在过去的一年里，很多人都接触过这台服务器，所以我想知道它是否缺少库、安装的软件包不正确等。我希望如果我们能理解这种情况下出了什么问题，这将有助于解释为什么我们在其他几个场景中出现段错误。

任何有关解决此段错误的提示都将不胜感激！

我不断收到（大约每 5-6 小时一次）apache 中的这个段错误：

[Tue Jun 26 12:43:10 2012] [notice] child pid 26810 exit signal Aborted (6)
*** glibc detected *** /usr/sbin/apache2: free(): invalid pointer: 0xb68c2628 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x6ff22)[0xb75aef22]
/lib/i386-linux-gnu/libc.so.6(+0x70bc2)[0xb75afbc2]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0xb75b2cad]
/usr/lib/apache2/modules/libphp5.so(destroy_zend_class+0x228)[0xb5d40518]
/usr/lib/apache2/modules/libphp5.so(zend_hash_clean+0x77)[0xb5d58957]
/usr/lib/php5/220100525+lfs/apc.so(apc_interned_strings_shutdown+0x32)[0xb64930b2]
/usr/lib/apache2/modules/libphp5.so(+0x318ff0)[0xb5d56ff0]
/usr/lib/apache2/modules/libphp5.so(zend_hash_graceful_reverse_destroy+0x27)[0xb5d58a67]
/usr/lib/apache2/modules/libphp5.so(zend_destroy_modules+0x3c)[0xb5d506cc]
/usr/lib/apache2/modules/libphp5.so(+0x30c743)[0xb5d4a743]
/usr/lib/apache2/modules/libphp5.so(php_module_shutdown+0x42)[0xb5ce5172]
/usr/lib/apache2/modules/libphp5.so(php_module_shutdown_wrapper+0x17)[0xb5ce5257]
/usr/lib/apache2/modules/libphp5.so(+0x3bebe1)[0xb5dfcbe1]
/usr/lib/libapr-1.so.0(+0x19846)[0xb76f2846]
/usr/lib/libapr-1.so.0(apr_pool_destroy+0x52)[0xb76f19ec]
/usr/sbin/apache2(+0x4ccee)[0xb77eccee]
======= Memory map: ========
b2e18000-b2e2c000 rw-s 00000000 00:04 8841030    /dev/zero (deleted)
b2e2c000-b2eaa000 rw-s 00000000 00:04 8841029    /dev/zero (deleted)
b2eaa000-b2eab000 ---p 00000000 00:00 0 
b2eab000-b36ab000 rw-p 00000000 00:00 0 
b5900000-b5921000 rw-p 00000000 00:00 0 
b5921000-b5a00000 ---p 00000000 00:00 0 
b5a3e000-b60bd000 r-xp 00000000 ca:00 44137      /usr/lib/apache2/modules/libphp5.so
b60bd000-b611e000 r--p 0067f000 ca:00 44137      /usr/lib/apache2/modules/libphp5.so
b611e000-b6123000 rw-p 006e0000 ca:00 44137      /usr/lib/apache2/modules/libphp5.so
b6123000-b6142000 rw-p 00000000 00:00 0 
b6142000-b6147000 r-xp 00000000 ca:00 24570      /lib/i386-linux-gnu/libnss_dns-2.13.so
b6147000-b6148000 r--p 00004000 ca:00 24570      /lib/i386-linux-gnu/libnss_dns-2.13.so
b6148000-b6149000 rw-p 00005000 ca:00 24570      /lib/i386-linux-gnu/libnss_dns-2.13.so
b6149000-b6175000 rw-p 00000000 00:00 0 
b6175000-b6180000 r-xp 00000000 ca:00 24572      /lib/i386-linux-gnu/libnss_files-2.13.so
b6180000-b6181000 r--p 0000a000 ca:00 24572      /lib/i386-linux-gnu/libnss_files-2.13.so
b6181000-b6182000 rw-p 0000b000 ca:00 24572      /lib/i386-linux-gnu/libnss_files-2.13.so
b6182000-b618c000 r-xp 00000000 ca:00 24576      /lib/i386-linux-gnu/libnss_nis-2.13.so
b618c000-b618d000 r--p 00009000 ca:00 24576      /lib/i386-linux-gnu/libnss_nis-2.13.so
b618d000-b618e000 rw-p 0000a000 ca:00 24576      /lib/i386-linux-gnu/libnss_nis-2.13.so
b618e000-b6196000 r-xp 00000000 ca:00 24562      /lib/i386-linux-gnu/libnss_compat-2.13.so
b6196000-b6197000 r--p 00007000 ca:00 24562      /lib/i386-linux-gnu/libnss_compat-2.13.so
b6197000-b6198000 rw-p 00008000 ca:00 24562      /lib/i386-linux-gnu/libnss_compat-2.13.so
b6198000-b6270000 rw-p 00000000 00:00 0 
b6270000-b6274000 rw-p 00000000 00:00 0 
b6468000-b6474000 rw-p 00000000 00:00 0 
b6475000-b6479000 rw-p 00000000 00:00 0 
b6479000-b649a000 r-xp 00000000 ca:00 65670      /usr/lib/php5/220100525+lfs/apc.so
b649a000-b649b000 r--p 00021000 ca:00 65670      /usr/lib/php5/220100525+lfs/apc.so
b649b000-b649c000 rw-p 00022000 ca:00 65670      /usr/lib/php5/220100525+lfs/apc.so
b649c000-b64a1000 rw-p 00000000 00:00 0 
b64a1000-b64a6000 rw-p 00000000 00:00 0 
b64a7000-b64aa000 rw-p 00000000 00:00 0 
b64aa000-b64af000 rw-p 00000000 00:00 0 
b64b0000-b64b3000 rw-p 00000000 00:00 0 
b64bf000-b64c4000 rw-p 00000000 00:00 0 
b64c4000-b64c9000 rw-p 00000000 00:00 0 
b64c9000-b64cc000 rw-p 00000000 00:00 0 
b64cd000-b64cf000 rw-p 00000000 00:00 0 
b64ea000-b64fd000 r-xp 00000000 ca:00 24598      /lib/i386-linux-gnu/libresolv-2.13.so
b64fd000-b64fe000 r--p 00012000 ca:00 24598      /lib/i386-linux-gnu/libresolv-2.13.so
b64fe000-b64ff000 rw-p 00013000 ca:00 24598      /lib/i386-linux-gnu/libresolv-2.13.so
b64ff000-b6501000 rw-p 00000000 00:00 0 
b650e000-b652a000 r-xp 00000000 ca:00 22450      /lib/i386-linux-gnu/libgcc_s.so.1
b652a000-b652b000 r--p 0001b000 ca:00 22450      /lib/i386-linux-gnu/libgcc_s.so.1
b652b000-b652c000 rw-p 0001c000 ca:00 22450      /lib/i386-linux-gnu/libgcc_s.so.1
b652c000-b6534000 rw-p 00000000 00:00 0 
b65dd000-b65df000 rw-p 00000000 00:00 0 
b67ad000-b67c2000 r-xp 00000000 ca:00 22063      /lib/i386-linux-gnu/libnsl-2.13.so
b67c2000-b67c3000 r--p 00015000 ca:00 22063      /lib/i386-linux-gnu/libnsl-2.13.so
b67c3000-b67c4000 rw-p 00016000 ca:00 22063      /lib/i386-linux-gnu/libnsl-2.13.so
b67c4000-b67c6000 rw-p 00000000 00:00 0 
b67c6000-b67ee000 r-xp 00000000 ca:00 21904      /lib/i386-linux-gnu/libm-2.13.so
b67ee000-b67ef000 r--p 00028000 ca:00 21904      /lib/i386-linux-gnu/libm-2.13.so
b67ef000-b67f0000 rw-p 00029000 ca:00 21904      /lib/i386-linux-gnu/libm-2.13.so
b67f0000-b67f7000 r-xp 00000000 ca:00 24600      /lib/i386-linux-gnu/librt-2.13.so
b67f7000-b67f8000 r--p 00006000 ca:00 24600      /lib/i386-linux-gnu/librt-2.13.so
b67f8000-b67f9000 rw-p 00007000 ca:00 24600      /lib/i386-linux-gnu/librt-2.13.so
b6886000-b69af000 rw-p 00000000 00:00 0 
b69af000-b6b3c000 r-xp 00000000 ca:00 23592      /lib/i386-linux-gnu/libcrypto.so.1.0.0
b6b3c000-b6b4a000 r--p 0018d000 ca:00 23592      /lib/i386-linux-gnu/libcrypto.so.1.0.0
b6b4a000-b6b50000 rw-p 0019b000 ca:00 23592      /lib/i386-linux-gnu/libcrypto.so.1.0.0
b6b50000-b6b53000 rw-p 00000000 00:00 0 
b6b53000-b6b9b000 r-xp 00000000 ca:00 23621      /lib/i386-linux-gnu/libssl.so.1.0.0
b6b9b000-b6b9d000 r--p 00047000 ca:00 23621      /lib/i386-linux-gnu/libssl.so.1.0.0
b6b9d000-b6ba0000 rw-p 00049000 ca:00 23621      /lib/i386-linux-gnu/libssl.so.1.0.0
b6ba0000-b6c7e000 r-xp 00000000 ca:00 9878       /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b6c7e000-b6c7f000 ---p 000de000 ca:00 9878       /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b6c7f000-b6c83000 r--p 000de000 ca:00 9878       /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b6c83000-b6c84000 rw-p 000e2000 ca:00 9878       /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b6c84000-b6c8b000 rw-p 00000000 00:00 0 
b6c93000-b6cd4000 rw-p 00000000 00:00 0 
b6cd4000-b6ce0000 rw-p 00000000 00:00 0 
b6cea000-b6cef000 r-xp 00000000 ca:00 45178      /usr/lib/apache2/modules/mod_status.so
b6cef000-b6cf0000 r--p 00004000 ca:00 45178      /usr/lib/apache2/modules/mod_status.so
b6cf0000-b6cf1000 rw-p 00005000 ca:00 45178      /usr/lib/apache2/modules/mod_status.so
b6cf1000-b6d19000 r-xp 00000000 ca:00 45175      /usr/lib/apache2/modules/mod_ssl.so
b6d19000-b6d1a000 ---p 00028000 ca:00 45175      /usr/lib/apache2/modules/mod_ssl.so
b6d1a000-b6d1b000 r--p 00028000 ca:00 45175      /usr/lib/apache2/modules/mod_ssl.so
b6d1b000-b6d1c000 rw-p 00029000 ca:00 45175      /usr/lib/apache2/modules/mod_ssl.so
b6d1c000-b6d1e000 rw-p 00000000 00:00 0 
b6d1e000-b6d20000 r-xp 00000000 ca:00 45166      /usr/lib/apache2/modules/mod_setenvif.so
b6d20000-b6d21000 r--p 00001000 ca:00 45166      /usr/lib/apache2/modules/mod_setenvif.so
b6d21000-b6d22000 rw-p 00002000 ca:00 45166      /usr/lib/apache2/modules/mod_setenvif.so
b6d22000-b6d30000 r-xp 00000000 ca:00 45195      /usr/lib/apache2/modules/mod_rewrite.so
b6d30000-b6d31000 r--p 0000e000 ca:00 45195      /usr/lib/apache2/modules/mod_rewrite.so
b6d31000-b6d32000 rw-p 0000f000 ca:00 45195      /usr/lib/apache2/modules/mod_rewrite.so
b6d32000-b6d45000 r-xp 00000000 ca:00 45168      /usr/lib/apache2/modules/mod_proxy.so
b6d45000-b6d46000 r--p 00012000 ca:00 45168      /usr/lib/apache2/modules/mod_proxy.so
b6d46000-b6d47000 rw-p 00013000 ca:00 45168      /usr/lib/apache2/modules/mod_proxy.so
b6d47000-b6d4e000 r-xp 00000000 ca:00 9904       /usr/lib/i386-linux-gnu/libkrb5support.so.0.1
b6d4e000-b6d4f000 r--p 00006000 ca:00 9904       /usr/lib/i386-linux-gnu/libkrb5support.so.0.1
b6d4f000-b6d50000 rw-p 00007000 ca:00 9904       /usr/lib/i386-linux-gnu/libkrb5support.so.0.1
b6d50000-b6e97000 r-xp 00000000 ca:00 3416       /usr/lib/libxml2.so.2.7.8
b6e97000-b6e9b000 r--p 00147000 ca:00 3416       /usr/lib/libxml2.so.2.7.8
b6e9b000-b6e9c000 rw-p 0014b000 ca:00 3416       /usr/lib/libxml2.so.2.7.8
b6e9c000-b6e9d000 rw-p 00000000 00:00 0 
b6e9d000-b6ec4000 r-xp 00000000 ca:00 12282      /usr/lib/i386-linux-gnu/libk5crypto.so.3.1
b6ec4000-b6ec5000 r--p 00026000 ca:00 12282      /usr/lib/i386-linux-gnu/libk5crypto.so.3.1
b6ec5000-b6ec6000 rw-p 00027000 ca:00 12282      /usr/lib/i386-linux-gnu/libk5crypto.so.3.1
b6ec6000-b6f88000 r-xp 00000000 ca:00 13335      /usr/lib/i386-linux-gnu/libkrb5.so.3.3
b6f88000-b6f8e000 r--p 000c1000 ca:00 13335      /usr/lib/i386-linux-gnu/libkrb5.so.3.3
b6f8e000-b6f8f000 rw-p 000c7000 ca:00 13335      /usr/lib/i386-linux-gnu/libkrb5.so.3.3
b6f8f000-b6fca000 r-xp 00000000 ca:00 9854       /usr/lib/i386-linux-gnu/libgssapi_krb5.so.2.2
b6fca000-b6fcb000 ---p 0003b000 ca:00 9854       /usr/lib/i386-linux-gnu/libgssapi_krb5.so.2.2
b6fcb000-b6fcc000 r--p 0003b000 ca:00 9854       /usr/lib/i386-linux-gnu/libgssapi_krb5.so.2.2
b6fcc000-b6fcd000 rw-p 0003c000 ca:00 9854       /usr/lib/i386-linux-gnu/libgssapi_krb5.so.2.2
b6fcd000-b6fdc000 r-xp 00000000 ca:00 21797      /lib/libbz2.so.1.0.4
b6fdc000-b6fdd000 r--p 0000e000 ca:00 21797      /lib/libbz2.so.1.0.4
b6fdd000-b6fde000 rw-p 0000f000 ca:00 21797      /lib/libbz2.so.1.0.4
b6fde000-b702a000 r-xp 00000000 ca:00 2505       /usr/lib/libqdbm.so.14.13.0
b702a000-b702b000 r--p 0004c000 ca:00 2505       /usr/lib/libqdbm.so.14.13.0
b702b000-b702c000 rw-p 0004d000 ca:00 2505       /usr/lib/libqdbm.so.14.13.0
b702c000-b71aa000 r-xp 00000000 ca:00 10201      /usr/lib/i386-linux-gnu/libdb-4.8.so
b71aa000-b71ac000 r--p 0017d000 ca:00 10201      /usr/lib/i386-linux-gnu/libdb-4.8.so
b71ac000-b71ad000 rw-p 0017f000 ca:00 10201      /usr/lib/i386-linux-gnu/libdb-4.8.so
b71ad000-b71f7000 r-xp 00000000 ca:00 23521      /lib/libssl.so.0.9.8
b71f7000-b71f8000 r--p 0004a000 ca:00 23521      /lib/libssl.so.0.9.8
b71f8000-b71fb000 rw-p 0004b000 ca:00 23521      /lib/libssl.so.0.9.8
b71fb000-b7359000 r-xp 00000000 ca:00 835379     /lib/libcrypto.so.0.9.8
b7359000-b735a000 ---p 0015e000 ca:00 835379     /lib/libcrypto.so.0.9.8
b735a000-b7362000 r--p 0015e000 ca:00 835379     /lib/libcrypto.so.0.9.8
b7362000-b7371000 rw-p 00166000 ca:00 835379     /lib/libcrypto.so.0.9.8
b7371000-b7374000 rw-p 00000000 00:00 0 
b7374000-b73ba000 r-xp 00000000 ca:00 2503       /usr/lib/libonig.so.2.0.0
b73ba000-b73bd000 rw-p 00045000 ca:00 2503       /usr/lib/libonig.so.2.0.0
b73be000-b73c0000 rw-p 00000000 00:00 0 
b73c0000-b73c7000 r-xp 00000000 ca:00 45171      /usr/lib/apache2/modules/mod_proxy_http.so
b73c7000-b73c8000 r--p 00006000 ca:00 45171      /usr/lib/apache2/modules/mod_proxy_http.so
b73c8000-b73c9000 rw-p 00007000 ca:00 45171      /usr/lib/apache2/modules/mod_proxy_http.so
b73c9000-b73dc000 r-xp 00000000 ca:00 22461      /lib/i386-linux-gnu/libz.so.1.2.3.4
b73dc000-b73dd000 r--p 00012000 ca:00 22461      /lib/i386-linux-gnu/libz.so.1.2.3.4
b73dd000-b73de000 rw-p 00013000 ca:00 22461      /lib/i386-linux-gnu/libz.so.1.2.3.4
b73de000-b73e3000 rw-p 00000000 00:00 0 
b73e3000-b73ea000 r-xp 00000000 ca:00 45188      /usr/lib/apache2/modules/mod_negotiation.so
b73ea000-b73eb000 r--p 00006000 ca:00 45188      /usr/lib/apache2/modules/mod_negotiation.so
b73eb000-b73ec000 rw-p 00007000 ca:00 45188      /usr/lib/apache2/modules/mod_negotiation.so
b73ec000-b73f1000 rw-p 00000000 00:00 0 
b73f2000-b73f5000 r-xp 00000000 ca:00 45149      /usr/lib/apache2/modules/mod_reqtimeout.so
b73f5000-b73f6000 r--p 00002000 ca:00 45149      /usr/lib/apache2/modules/mod_reqtimeout.so
b73f6000-b73f7000 rw-p 00003000 ca:00 45149      /usr/lib/apache2/modules/mod_reqtimeout.so
b73f7000-b73fc000 rw-p 00000000 00:00 0 
b73fc000-b73fe000 rw-p 00000000 00:00 0 
b73fe000-b7400000 r-xp 00000000 ca:00 22437      /lib/i386-linux-gnu/libkeyutils.so.1.3
b7400000-b7401000 r--p 00001000 ca:00 22437      /lib/i386-linux-gnu/libkeyutils.so.1.3
b7401000-b7402000 rw-p 00002000 ca:00 22437      /lib/i386-linux-gnu/libkeyutils.so.1.3
b7402000-b7407000 rw-p 00000000 00:00 0 
b7407000-b7409000 r-xp 00000000 ca:00 22344      /lib/i386-linux-gnu/libcom_err.so.2.1
b7409000-b740a000 r--p 00001000 ca:00 22344      /lib/i386-linux-gnu/libcom_err.so.2.1
b740a000-b740b000 rw-p 00002000 ca:00 22344      /lib/i386-linux-gnu/libcom_err.so.2.1
b740b000-b7410000 rw-p 00000000 00:00 0 
b7411000-b7413000 rw-p 00000000 00:00 0 
b7413000-b7416000 rw-p 00000000 00:00 0 
b7416000-b7418000 rw-p 00000000 00:00 0 
b7418000-b741c000 r-xp 00000000 ca:00 45176      /usr/lib/apache2/modules/mod_mime.so
b741c000-b741d000 r--p 00003000 ca:00 45176      /usr/lib/apache2/modules/mod_mime.so
b741d000-b741e000 rw-p 00004000 ca:00 45176      /usr/lib/apache2/modules/mod_mime.so
b741e000-b7422000 r-xp 00000000 ca:00 45162      /usr/lib/apache2/modules/mod_headers.so
b7422000-b7423000 r--p 00003000 ca:00 45162      /usr/lib/apache2/modules/mod_headers.so
b7423000-b7424000 rw-p 00004000 ca:00 45162      /usr/lib/apache2/modules/mod_headers.so
b7424000-b7426000 r-xp 00000000 ca:00 45161      /usr/lib/apache2/modules/mod_expires.so
b7426000-b7427000 r--p 00001000 ca:00 45161      /usr/lib/apache2/modules/mod_expires.so
b7427000-b7428000 rw-p 00002000 ca:00 45161      /usr/lib/apache2/modules/mod_expires.so
b7428000-b742a000 r-xp 00000000 ca:00 45189      /usr/lib/apache2/modules/mod_dir.so
b742a000-b742b000 r--p 00001000 ca:00 45189      /usr/lib/apache2/modules/mod_dir.so
b742b000-b742c000 rw-p 00002000 ca:00 45189      /usr/lib/apache2/modules/mod_dir.so
b742c000-b742e000 rw-p 00000000 00:00 0 
b742f000-b7430000 r-xp 00000000 ca:00 45158      /usr/lib/apache2/modules/mod_env.so
b7430000-b7431000 r--p 00000000 ca:00 45158      /usr/lib/apache2/modules/mod_env.so
b7431000-b7432000 rw-p 00001000 ca:00 45158      /usr/lib/apache2/modules/mod_env.so
b7432000-b7437000 rw-p 00000000 00:00 0 
b7437000-b743c000 r-xp 00000000 ca:00 45155      /usr/lib/apache2/modules/mod_deflate.so
b743c000-b743d000 r--p 00004000 ca:00 45155      /usr/lib/apache2/modules/mod_deflate.so
b743d000-b743e000 rw-p 00005000 ca:00 45155      /usr/lib/apache2/modules/mod_deflate.so
b743e000-b7443000 rw-p 00000000 00:00 0 
b7443000-b7448000 r-xp 00000000 ca:00 45184      /usr/lib/apache2/modules/mod_cgi.so
b7448000-b7449000 r--p 00004000 ca:00 45184      /usr/lib/apache2/modules/mod_cgi.so
b7449000-b744a000 rw-p 00005000 ca:00 45184      /usr/lib/apache2/modules/mod_cgi.so
b744a000-b744f000 rw-p 00000000 00:00 0 
b744f000-b7457000 r-xp 00000000 ca:00 45179      /usr/lib/apache2/modules/mod_autoindex.so
b7457000-b7458000 r--p 00007000 ca:00 45179      /usr/lib/apache2/modules/mod_autoindex.so
b7458000-b7459000 rw-p 00008000 ca:00 45179      /usr/lib/apache2/modules/mod_autoindex.so
b7459000-b745e000 rw-p 00000000 00:00 0 
b745e000-b745f000 r-xp 00000000 ca:00 45136      /usr/lib/apache2/modules/mod_authz_user.so
b745f000-b7460000 r--p 00000000 ca:00 45136      /usr/lib/apache2/modules/mod_authz_user.so
b7460000-b7461000 rw-p 00001000 ca:00 45136      /usr/lib/apache2/modules/mod_authz_user.so
b7461000-b7466000 rw-p 00000000 00:00 0 
b7466000-b7468000 r-xp 00000000 ca:00 45134      /usr/lib/apache2/modules/mod_authz_host.so
b7468000-b7469000 r--p 00001000 ca:00 45134      /usr/lib/apache2/modules/mod_authz_host.so
b7469000-b746a000 rw-p 00002000 ca:00 45134      /usr/lib/apache2/modules/mod_authz_host.so
b746a000-b746f000 rw-p 00000000 00:00 0 
b746f000-b7471000 r-xp 00000000 ca:00 45135      /usr/lib/apache2/modules/mod_authz_groupfile.so
b7471000-b7472000 r--p 00001000 ca:00 45135      /usr/lib/apache2/modules/mod_authz_groupfile.so
b7472000-b7473000 rw-p 00002000 ca:00 45135      /usr/lib/apache2/modules/mod_authz_groupfile.so
b7473000-b7478000 rw-p 00000000 00:00 0 
b7478000-b7479000 r-xp 00000000 ca:00 45140      /usr/lib/apache2/modules/mod_authz_default.so
b7479000-b747a000 r--p 00000000 ca:00 45140      /usr/lib/apache2/modules/mod_authz_default.so
b747a000-b747b000 rw-p 00001000 ca:00 45140      /usr/lib/apache2/modules/mod_authz_default.so
b747b000-b7480000 rw-p 00000000 00:00 0 
b7480000-b7481000 r-xp 00000000 ca:00 44436      /usr/lib/apache2/modules/mod_authn_file.so
b7481000-b7482000 ---p 00001000 ca:00 44436      /usr/lib/apache2/modules/mod_authn_file.so
b7482000-b7483000 r--p 00001000 ca:00 44436      /usr/lib/apache2/modules/mod_authn_file.so
b7483000-b7484000 rw-p 00002000 ca:00 44436      /usr/lib/apache2/modules/mod_authn_file.so
b7484000-b7489000 rw-p 00000000 00:00 0 
b7489000-b748b000 r-xp 00000000 ca:00 45141      /usr/lib/apache2/modules/mod_auth_basic.so
b748b000-b748c000 r--p 00001000 ca:00 45141      /usr/lib/apache2/modules/mod_auth_basic.so
b748c000-b748d000 rw-p 00002000 ca:00 45141      /usr/lib/apache2/modules/mod_auth_basic.so
b748d000-b7492000 rw-p 00000000 00:00 0 
b7492000-b7495000 r-xp 00000000 ca:00 45194      /usr/lib/apache2/modules/mod_alias.so
b7495000-b7496000 r--p 00002000 ca:00 45194      /usr/lib/apache2/modules/mod_alias.so
b7496000-b7497000 rw-p 00003000 ca:00 45194      /usr/lib/apache2/modules/mod_alias.so
b7497000-b74d8000 rw-p 00000000 00:00 0 
b74d8000-b74db000 r-xp 00000000 ca:00 21902      /lib/i386-linux-gnu/libdl-2.13.so
b74db000-b74dc000 r--p 00002000 ca:00 21902      /lib/i386-linux-gnu/libdl-2.13.so
b74dc000-b74dd000 rw-p 00003000 ca:00 21902      /lib/i386-linux-gnu/libdl-2.13.so
b74dd000-b74de000 rw-p 00000000 00:00 0 
b74de000-b74e2000 r-xp 00000000 ca:00 22401      /lib/i386-linux-gnu/libuuid.so.1.3.0
b74e2000-b74e3000 r--p 00003000 ca:00 22401      /lib/i386-linux-gnu/libuuid.so.1.3.0
b74e3000-b74e4000 rw-p 00004000 ca:00 22401      /lib/i386-linux-gnu/libuuid.so.1.3.0
b74e4000-b750a000 r-xp 00000000 ca:00 22420      /lib/i386-linux-gnu/libexpat.so.1.5.2
b750a000-b750b000 ---p 00026000 ca:00 22420      /lib/i386-linux-gnu/libexpat.so.1.5.2
b750b000-b750d000 r--p 00026000 ca:00 22420      /lib/i386-linux-gnu/libexpat.so.1.5.2
b750d000-b750e000 rw-p 00028000 ca:00 22420      /lib/i386-linux-gnu/libexpat.so.1.5.2
b750e000-b7516000 r-xp 00000000 ca:00 21889      /lib/i386-linux-gnu/libcrypt-2.13.so
b7516000-b7517000 r--p 00007000 ca:00 21889      /lib/i386-linux-gnu/libcrypt-2.13.so
b7517000-b7518000 rw-p 00008000 ca:00 21889      /lib/i386-linux-gnu/libcrypt-2.13.so
b7518000-b753f000 rw-p 00000000 00:00 0 
b753f000-b76b7000 r-xp 00000000 ca:00 21864      /lib/i386-linux-gnu/libc-2.13.so
b76b7000-b76b9000 r--p 00178000 ca:00 21864      /lib/i386-linux-gnu/libc-2.13.so
b76b9000-b76ba000 rw-p 0017a000 ca:00 21864      /lib/i386-linux-gnu/libc-2.13.so
b76ba000-b76bd000 rw-p 00000000 00:00 0 
b76bd000-b76d4000 r-xp 00000000 ca:00 24594      /lib/i386-linux-gnu/libpthread-2.13.so
b76d4000-b76d5000 r--p 00016000 ca:00 24594      /lib/i386-linux-gnu/libpthread-2.13.so
b76d5000-b76d6000 rw-p 00017000 ca:00 24594      /lib/i386-linux-gnu/libpthread-2.13.so
b76d6000-b76d9000 rw-p 00000000 00:00 0 
b76d9000-b770c000 r-xp 00000000 ca:00 6233       /usr/lib/libapr-1.so.0.4.5
b770c000-b770d000 r--p 00032000 ca:00 6233       /usr/lib/libapr-1.so.0.4.5
b770d000-b770e000 rw-p 00033000 ca:00 6233       /usr/lib/libapr-1.so.0.4.5
b770e000-b772f000 r-xp 00000000 ca:00 6236       /usr/lib/libaprutil-1.so.0.3.12
b772f000-b7730000 r--p 00020000 ca:00 6236       /usr/lib/libaprutil-1.so.0.3.12
b7730000-b7731000 rw-p 00021000 ca:00 6236       /usr/lib/libaprutil-1.so.0.3.12
b7731000-b776e000 r-xp 00000000 ca:00 22336      /lib/i386-linux-gnu/libpcre.so.3.12.1
b776e000-b776f000 r--p 0003c000 ca:00 22336      /lib/i386-linux-gnu/libpcre.so.3.12.1
b776f000-b7770000 rw-p 0003d000 ca:00 22336      /lib/i386-linux-gnu/libpcre.so.3.12.1
b7770000-b7780000 rw-p 00000000 00:00 0 
b7780000-b779e000 r-xp 00000000 ca:00 21844      /lib/i386-linux-gnu/ld-2.13.so
b779e000-b779f000 r--p 0001d000 ca:00 21844      /lib/i386-linux-gnu/ld-2.13.so
b779f000-b77a0000 rw-p 0001e000 ca:00 21844      /lib/i386-linux-gnu/ld-2.13.so
b77a0000-b7803000 r-xp 00000000 ca:00 44432      /usr/lib/apache2/mpm-prefork/apache2
b7803000-b7805000 r--p 00063000 ca:00 44432      /usr/lib/apache2/mpm-prefork/apache2
b7805000-b7807000 rw-p 00065000 ca:00 44432      /usr/lib/apache2/mpm-prefork/apache2
b7807000-b780a000 rw-p 00000000 00:00 0 
b7a17000-b7a55000 rw-p 00000000 00:00 0          [heap]
b7a55000-b7b9f000 rw-p 00000000 00:00 0          [heap]
b7b9f000-b7c1a000 rw-p 00000000 00:00 0          [heap]
bf9a1000-bf9c2000 rw-p 00000000 00:00 0          [stack]
f57fe000-f57ff000 r-xp 00000000 00:00 0          [vdso]
[Tue Jun 26 13:15:10 2012] [notice] child pid 26840 exit signal Aborted (6)

有时它会恢复，但有时它会杀死服务器。我不清楚 glibc 为崩溃做了什么。任何人都可以破译此错误日志中的崩溃内容吗？

如果收到段错误信号，我的应用程序通常会崩溃并打印堆栈以记录。

但在某些环境中，“dmesg”会显示与我的应用程序相关的段错误消息，但应用程序的正常运行时间要长得多。

可以抑制段错误并且应用程序没有收到信号吗？或者来自 dmesg 的错误可能意味着什么？

每天都会出现这个错误

 kernel: crond[1234]: segfault at xxxxxxx rip xxxx rsp xxx error 14 

发生了什么

我有一个脚本间歇性地在 Firefox 中返回白屏死机和Error 324 (net::ERR_EMPTY_RESPONSE): Unknown error. chrome.

当我尝试使用 PHP HTTP 客户端（如 Zend_Http_Client）访问脚本时，我间歇性地收到一个异常（抱歉，我目前没有确切的消息）。

我怀疑是段错误。我的错误日志中如下所示的行进一步支持了这一点：[Thu Mar 18 16:03:02 2010] [notice] child pid 845 exit signal Segmentation fault (11)

现在，我正在运行 RedHat，而且我知道 RedHat 不会生成开箱即用的核心转储。我按照这里的说明http://kbase.redhat.com/faq/docs/DOC-5353，但我没有看到任何核心转储。

如何生成核心转储？