SvennD's questions

我想将 snmp 从一个 LAN 转发到另一个 LAN。我相信我有一种工作方式（从外到内），但遗憾的是 box1 似乎无法回复。（从里到外）

我想做的设置：

  box1                  box2             box3
[10.1.255.245] -------------------------- [public_ip]
    |               eth0-|-eth1               |
    |-----------3161---------------- 3161 ----|

这些是与 BOX 2 相关的 iptables 规则，

-A PREROUTING -i eth1 -p udp -m udp --dport 3161 -j DNAT --to-destination 10.1.255.244:3161
-A FORWARD -d 10.1.255.244/32 -p udp -m udp --dport 3161 -m state --state NEW,RELATED,ESTABLISHED -j ACCEPT

现在我验证了来自 box3 的包裹是在 box1 中收到的。

tcpdump 'port 3161'
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 65535 bytes
13:46:03.887718 IP x-20150810-092601.x.be.53329 > compute-0-2.local.doc1lm: UDP, length 48
13:46:04.888851 IP x-20150810-092601.x.be.53329 > compute-0-2.local.doc1lm: UDP, length 48
13:46:05.889977 IP x-20150810-092601.x.be.53329 > compute-0-2.local.doc1lm: UDP, length 48
13:46:06.891108 IP x-20150810-092601.x.be.53329 > compute-0-2.local.doc1lm: UDP, length 48

所以我假设 snmp 进程无法响应该位置，因为它不知道如何找到这个局域网外 ip……我该如何添加这个？这是 box1 上的路线：

Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
255.255.255.255 *               255.255.255.255 UH    0      0        0 eth0
box2 box2     255.255.255.255 UGH   0      0        0 eth0
224.0.0.0       *               255.255.255.0   U     0      0        0 eth0
10.1.0.0        *               255.255.0.0     U     0      0        0 eth0
link-local      *               255.255.0.0     U     1002   0        0 eth0
link-local      *               255.255.0.0     U     1003   0        0 eth1
192.168.0.0     *               255.255.0.0     U     0      0        0 eth1
default         storage          0.0.0.0         UG    0      0        0 eth1

还是我错过了其他明显的东西？

我们将有一台机器在工作，它在峰值性能下应该能够每小时推送50（“写头”）x 75GB的数据。这是约 1100MB/s 写入速度的峰值性能。要从机器上得到它，它需要两条 10GBi 线。我的问题是什么样的服务器+技术可以处理/存储这样的数据流？

目前对于数据存储，我们使用 ZFS，尽管写入速度从来都不是问题。（我们甚至没有接近这些速度）ZFS（Linux 上的 zfs）会是一个选项吗？我们还需要存储大量数据，“IT 指南”建议总共在 50-75 TB 之间。因此，除非我们想提供我们的第一个孩子，否则它可能不会都是 SSD。

基于优秀回复的一些补充：

• 峰值期间最大值为 50x75GB/小时，小于 24 小时（很可能 <6 小时）
• 我们预计这不会很快发生，我们很可能会以 5-10x75GB/小时的速度运行
• 它是一个 pre-alpha 机器，但是应该满足要求（即使有很多问号在起作用）
• 我们将使用NFS作为从机器到服务器的连接
• 布局：生成机->存储（这个）->（安全RAID 6）->计算集群
• 所以读取速度不是必需的，但是从计算集群中使用它会很好（但这完全是可选的）
• 很可能是大数据文件（不是很多小文件）

我们有两台大型存储服务器（+100TB），一台运行在 ZFS 上，另一台运行 XFS，我们打算将 XFS 用作我们的工作服务器并使用 ZFS 作为备份服务器（快照 <3）。现在的问题是让这些野兽保持同步......（同步为每日同步）

最简单的选择是使用 rsync，但遗憾的是目录结构很深，而且到处都是硬链接。所以这意味着我们需要进行一次“全局”扫描，这需要很长时间......最重要的是，大部分数据都是创建的，从未修改过。所以 rsync 可能不是要走的路。

我研究了inotify，它看起来相对便宜，而且因为我们只希望每天同步，所以可以卸载到美好的时光......遗憾的是，如果我们只查看创建的文件，我们会将硬链接复制为数据将使我们备份中使用的存储量翻倍......（基本上没有办法从 rsync 进行 -H 检查）

我能想到的唯一选择是重新组织我们的存储以使用基于日期的目录，遗憾的是，移动这么多数据并不是我们更喜欢的......

还有其他选择吗？

以供参考 ：

• 带有 XFS 的服务器有一个 RAID 控制器（无 JBOD 选项）和 SATA 磁盘 (WD RE)。32Gb 内存
• 具有 ZFS 的服务器具有 HBA 控制器和 SAS 磁盘。126Gb 内存

当我将 ZFS 称为缓慢时，我看到 'ls' 需要几秒钟......

我最近将我的服务器升级到 Centos 7；我要求用户在那里备份数据以进行升级。升级后，一些用户尝试解压缩备份 tar (~300Gb)，这导致服务器挂起/冻结。（不响应键盘/ssh 输入）（可重现）这也发生在其他占用大量资源的二进制文件中。

我监控了内存和 CPU，在冻结之前两者都是合理的，所以Centos 板上的结论是它是 I/0 限制。这似乎是正确的，因为解决方法nice成功完成了 untar。

我的问题是，我怎么能确定这不会在未来再次发生？（我可以限制 I/0 吗？）这是一台“离线”机器，因此用户期望有很大的试验自由度。（但显然我们不想每天都重置机器。）默认情况下我可以很好的流程吗？或者限制 I/0 使机器不会“冻结”？系统正在运行一个在 6 x 上具有 raid 6 的 raidcontrollerWestern Digital RE4

供参考的规格：（虽然工作量提高到 19）

iotop：（最大约 60 M/s）

Total DISK READ :      51.72 M/s | Total DISK WRITE :      42.40 M/s
Actual DISK READ:     786.07 K/s | Actual DISK WRITE:     131.94 K/s

顶部同时：

top - 09:58:27 up 1 day, 26 min,  6 users,  load average: 142.30, 144.85, 148.19
Tasks: 785 total,   8 running, 777 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.0 us,  6.5 sy, 93.0 ni,  0.0 id,  0.1 wa,  0.0 hi,  0.3 si,  0.0 st
KiB Mem : 52838147+total,   707112 free, 51992025+used,  7754104 buff/cache
KiB Swap:  4194300 total,        0 free,  4194300 used.  7746868 avail Mem

免费-m

              total        used        free      shared  buff/cache   available
Mem:         515997      507679         719           3        7598        7631
Swap:          4095        4095           0

猫 /proc/cpuinfo

processor       : 63
vendor_id       : GenuineIntel
cpu family      : 6
model           : 47
model name      : Intel(R) Xeon(R) CPU E7- 4830  @ 2.13GHz
stepping        : 2
microcode       : 0x37
cpu MHz         : 2134.000
cache size      : 24576 KB
physical id     : 3
siblings        : 16
core id         : 25
cpu cores       : 8
apicid          : 243
initial apicid  : 243
fpu             : yes
fpu_exception   : yes
cpuid level     : 11
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt aes lahf_lm ida arat epb dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips        : 4266.05
clflush size    : 64
cache_alignment : 64
address sizes   : 44 bits physical, 48 bits virtual
power management:

lspci (raid 控制器)

02:00.0 RAID bus controller: 3ware Inc 9750 SAS2/SATA-II RAID PCIe (rev 05)

系统 ：

cat /etc/redhat-release
CentOS Linux release 7.2.1511 (Core)
uname -r
3.10.0-327.el7.x86_64

 lspci
00:00.0 Host bridge: Intel Corporation 5520/5500/X58 I/O Hub to ESI Port (rev 22)
00:01.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1 (rev 22)
00:03.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 3 (rev 22)
00:07.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 (rev 22)
00:13.0 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub I/OxAPIC Interrupt Controller (rev 22)
00:14.0 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub System Management Registers (rev 22)
00:14.1 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers (rev 22)
00:14.2 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub Control Status and RAS Registers (rev 22)
00:14.3 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub Throttle Registers (rev 22)
00:1a.0 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4
00:1a.1 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5
00:1a.2 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6
00:1a.7 USB controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2
00:1b.0 Audio device: Intel Corporation 82801JI (ICH10 Family) HD Audio Controller
00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1
00:1d.0 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1
00:1d.1 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2
00:1d.2 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3
00:1d.7 USB controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90)
00:1f.0 ISA bridge: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller
00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE Controller #1
00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller
00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE Controller #2
02:00.0 RAID bus controller: 3ware Inc 9750 SAS2/SATA-II RAID PCIe (rev 05)
04:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
04:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
05:01.0 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200eW WPCM450 (rev 0a)
fc:00.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 1 (rev 0c)
fc:00.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 2 (rev 0c)
fc:00.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 3 (rev 0c)
fc:00.6 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 4 (rev 0c)
fc:01.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Power Controller (rev 0c)
fc:02.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 0 (rev 0c)
fc:03.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 1 (rev 0c)
fc:04.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 0 (rev 0c)
fc:05.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0a (rev 0c)
fc:05.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0b (rev 0c)
fc:05.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0c (rev 0c)
fc:05.6 Host bridge: Intel Corporation Device 2b53 (rev 0c)
fc:06.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 1 (rev 0c)
fc:07.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1a (rev 0c)
fc:07.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1b (rev 0c)
fc:07.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1c (rev 0c)
fc:07.6 Host bridge: Intel Corporation Device 2b5b (rev 0c)
fc:08.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 0 (rev 0c)
fc:09.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 1 (rev 0c)
fc:0a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 2 (rev 0c)
fc:0b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 3 (rev 0c)
fc:0c.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 4 (rev 0c)
fc:0d.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 5 (rev 0c)
fc:0e.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 6 (rev 0c)
fc:0f.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 7 (rev 0c)
fc:10.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 0-1 (rev 0c)
fc:10.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 2-3 (rev 0c)
fc:10.4 Host bridge: Intel Corporation Device 2b32 (rev 0c)
fc:10.6 Host bridge: Intel Corporation Device 2b3a (rev 0c)
fc:11.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 4-5 (rev 0c)
fc:11.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 6-7 (rev 0c)
fc:11.4 Host bridge: Intel Corporation Device 2b36 (rev 0c)
fc:11.6 Host bridge: Intel Corporation Device 2b3e (rev 0c)
fc:12.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 0 (rev 0c)
fc:13.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 1 (rev 0c)
fc:14.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: REUT control/status (rev 0c)
fc:14.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: Misc. control/status (rev 0c)
fc:15.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: REUT control/status (rev 0c)
fc:15.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: Misc. control/status (rev 0c)
fc:17.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: REUT control/status (rev 0c)
fc:17.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: Misc. control/status (rev 0c)
fc:18.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: REUT control/status (rev 0c)
fc:18.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: Misc control/status (rev 0c)
fc:19.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: REUT control/status (rev 0c)
fc:19.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: Misc control/status (rev 0c)
fc:1a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 8 (rev 0c)
fc:1b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 9 (rev 0c)
fd:00.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 1 (rev 0c)
fd:00.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 2 (rev 0c)
fd:00.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 3 (rev 0c)
fd:00.6 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 4 (rev 0c)
fd:01.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Power Controller (rev 0c)
fd:02.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 0 (rev 0c)
fd:03.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 1 (rev 0c)
fd:04.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 0 (rev 0c)
fd:05.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0a (rev 0c)
fd:05.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0b (rev 0c)
fd:05.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0c (rev 0c)
fd:05.6 Host bridge: Intel Corporation Device 2b53 (rev 0c)
fd:06.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 1 (rev 0c)
fd:07.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1a (rev 0c)
fd:07.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1b (rev 0c)
fd:07.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1c (rev 0c)
fd:07.6 Host bridge: Intel Corporation Device 2b5b (rev 0c)
fd:08.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 0 (rev 0c)
fd:09.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 1 (rev 0c)
fd:0a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 2 (rev 0c)
fd:0b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 3 (rev 0c)
fd:0c.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 4 (rev 0c)
fd:0d.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 5 (rev 0c)
fd:0e.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 6 (rev 0c)
fd:0f.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 7 (rev 0c)
fd:10.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 0-1 (rev 0c)
fd:10.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 2-3 (rev 0c)
fd:10.4 Host bridge: Intel Corporation Device 2b32 (rev 0c)
fd:10.6 Host bridge: Intel Corporation Device 2b3a (rev 0c)
fd:11.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 4-5 (rev 0c)
fd:11.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 6-7 (rev 0c)
fd:11.4 Host bridge: Intel Corporation Device 2b36 (rev 0c)
fd:11.6 Host bridge: Intel Corporation Device 2b3e (rev 0c)
fd:12.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 0 (rev 0c)
fd:13.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 1 (rev 0c)
fd:14.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: REUT control/status (rev 0c)
fd:14.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: Misc. control/status (rev 0c)
fd:15.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: REUT control/status (rev 0c)
fd:15.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: Misc. control/status (rev 0c)
fd:17.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: REUT control/status (rev 0c)
fd:17.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: Misc. control/status (rev 0c)
fd:18.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: REUT control/status (rev 0c)
fd:18.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: Misc control/status (rev 0c)
fd:19.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: REUT control/status (rev 0c)
fd:19.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: Misc control/status (rev 0c)
fd:1a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 8 (rev 0c)
fd:1b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 9 (rev 0c)
fe:00.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 1 (rev 0c)
fe:00.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 2 (rev 0c)
fe:00.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 3 (rev 0c)
fe:00.6 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 4 (rev 0c)
fe:01.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Power Controller (rev 0c)
fe:02.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 0 (rev 0c)
fe:03.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 1 (rev 0c)
fe:04.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 0 (rev 0c)
fe:05.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0a (rev 0c)
fe:05.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0b (rev 0c)
fe:05.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0c (rev 0c)
fe:05.6 Host bridge: Intel Corporation Device 2b53 (rev 0c)
fe:06.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 1 (rev 0c)
fe:07.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1a (rev 0c)
fe:07.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1b (rev 0c)
fe:07.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1c (rev 0c)
fe:07.6 Host bridge: Intel Corporation Device 2b5b (rev 0c)
fe:08.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 0 (rev 0c)
fe:09.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 1 (rev 0c)
fe:0a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 2 (rev 0c)
fe:0b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 3 (rev 0c)
fe:0c.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 4 (rev 0c)
fe:0d.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 5 (rev 0c)
fe:0e.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 6 (rev 0c)
fe:0f.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 7 (rev 0c)
fe:10.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 0-1 (rev 0c)
fe:10.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 2-3 (rev 0c)
fe:10.4 Host bridge: Intel Corporation Device 2b32 (rev 0c)
fe:10.6 Host bridge: Intel Corporation Device 2b3a (rev 0c)
fe:11.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 4-5 (rev 0c)
fe:11.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 6-7 (rev 0c)
fe:11.4 Host bridge: Intel Corporation Device 2b36 (rev 0c)
fe:11.6 Host bridge: Intel Corporation Device 2b3e (rev 0c)
fe:12.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 0 (rev 0c)
fe:13.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 1 (rev 0c)
fe:14.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: REUT control/status (rev 0c)
fe:14.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: Misc. control/status (rev 0c)
fe:15.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: REUT control/status (rev 0c)
fe:15.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: Misc. control/status (rev 0c)
fe:16.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 2: REUT control/status (rev 0c)
fe:16.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 2: Misc. control/status (rev 0c)
fe:17.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: REUT control/status (rev 0c)
fe:17.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: Misc. control/status (rev 0c)
fe:18.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: REUT control/status (rev 0c)
fe:18.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: Misc control/status (rev 0c)
fe:19.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: REUT control/status (rev 0c)
fe:19.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: Misc control/status (rev 0c)
fe:1a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 8 (rev 0c)
fe:1b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 9 (rev 0c)
ff:00.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 1 (rev 0c)
ff:00.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 2 (rev 0c)
ff:00.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 3 (rev 0c)
ff:00.6 Host bridge: Intel Corporation Xeon Processor E7 Product Family System Configuration Controller 4 (rev 0c)
ff:01.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Power Controller (rev 0c)
ff:02.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 0 (rev 0c)
ff:03.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Caching Agent 1 (rev 0c)
ff:04.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 0 (rev 0c)
ff:05.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0a (rev 0c)
ff:05.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0b (rev 0c)
ff:05.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 0c (rev 0c)
ff:05.6 Host bridge: Intel Corporation Device 2b53 (rev 0c)
ff:06.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Home Agent 1 (rev 0c)
ff:07.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1a (rev 0c)
ff:07.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1b (rev 0c)
ff:07.4 Host bridge: Intel Corporation Xeon Processor E7 Product Family Memory Controller 1c (rev 0c)
ff:07.6 Host bridge: Intel Corporation Device 2b5b (rev 0c)
ff:08.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 0 (rev 0c)
ff:09.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 1 (rev 0c)
ff:0a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 2 (rev 0c)
ff:0b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 3 (rev 0c)
ff:0c.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 4 (rev 0c)
ff:0d.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 5 (rev 0c)
ff:0e.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 6 (rev 0c)
ff:0f.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 7 (rev 0c)
ff:10.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 0-1 (rev 0c)
ff:10.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 2-3 (rev 0c)
ff:10.4 Host bridge: Intel Corporation Device 2b32 (rev 0c)
ff:10.6 Host bridge: Intel Corporation Device 2b3a (rev 0c)
ff:11.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 4-5 (rev 0c)
ff:11.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Router Port 6-7 (rev 0c)
ff:11.4 Host bridge: Intel Corporation Device 2b36 (rev 0c)
ff:11.6 Host bridge: Intel Corporation Device 2b3e (rev 0c)
ff:12.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 0 (rev 0c)
ff:13.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Test and Debug 1 (rev 0c)
ff:14.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: REUT control/status (rev 0c)
ff:14.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 0: Misc. control/status (rev 0c)
ff:15.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: REUT control/status (rev 0c)
ff:15.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 1: Misc. control/status (rev 0c)
ff:16.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 2: REUT control/status (rev 0c)
ff:16.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 2: Misc. control/status (rev 0c)
ff:17.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: REUT control/status (rev 0c)
ff:17.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family QPI Physical Port 3: Misc. control/status (rev 0c)
ff:18.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: REUT control/status (rev 0c)
ff:18.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 0: Misc control/status (rev 0c)
ff:19.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: REUT control/status (rev 0c)
ff:19.2 Host bridge: Intel Corporation Xeon Processor E7 Product Family SMI Physical Port 1: Misc control/status (rev 0c)
ff:1a.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 8 (rev 0c)
ff:1b.0 Host bridge: Intel Corporation Xeon Processor E7 Product Family Last Level Cache Coherence Engine 9 (rev 0c)

// 更新

• 这也发生在分配 java 作业的运行中，文件系统在冻结之前感觉“慢”。（ls -l，猫，...）
• 更改标题以反映工作量，而不仅仅是 tar。

我们的存储服务器有一些问题，就在之前我们有一个损坏的磁盘（WD 4TB RE SAS），尽管 raidcontroller（LSI MegaRAID 9271-8i）保持磁盘在线（状态：ok）。只有媒体错误显示 1 个错误。我们决定保存并更换磁盘，在重新同步期间，第二个和第一个磁盘标记为（重新同步），尽管只有一个磁盘显示 1 个读取错误。今天 resilver 完成了（没有损坏，一切正常），我开始了擦洗并遇到了这个：

zpool status
  pool: data
 state: DEGRADED
status: One or more devices could not be used because the label is missing or
        invalid.  Sufficient replicas exist for the pool to continue
        functioning in a degraded state.
action: Replace the device using 'zpool replace'.
   see: http://zfsonlinux.org/msg/ZFS-8000-4J
  scan: scrub in progress since Thu Jan 14 10:50:00 2016
    2.71T scanned out of 111T at 718M/s, 43h59m to go
    0 repaired, 2.44% done
config:

        NAME                     STATE     READ WRITE CKSUM
        data                     DEGRADED     0     0     0
          raidz2-0               DEGRADED     0     0     0
            br0c2                ONLINE       0     0     0
            br1c2                ONLINE       0     0     0
            br2c2                ONLINE       0     0     0
            br0c3                ONLINE       0     0     0
            br1c3                ONLINE       0     0     0
            br2c3                ONLINE       0     0     0
            r2c1                 ONLINE       0     0     0
            r1c2                 ONLINE       0     0     0
            r5c3                 ONLINE       0     0     0
            sdb                  ONLINE       0     0     0
            sdc                  ONLINE       0     0     0
            7196084230607724634  FAULTED      0     0     0  was /dev/sdai1
            r5c0                 ONLINE       0     0     0
            r0c1                 ONLINE       0     0     0
            r1c1                 ONLINE       0     0     0
            r3c1                 ONLINE       0     0     0
            r4c1                 ONLINE       0     0     0
          raidz2-1               ONLINE       0     0     0
            r5c1                 ONLINE       0     0     0
            r0c2                 ONLINE       0     0     0
            r2c2                 ONLINE       0     0     0
            r3c2                 ONLINE       0     0     0
            r4c2                 ONLINE       0     0     0
            r5c2                 ONLINE       0     0     0
            r0c3                 ONLINE       0     0     0
            r1c3                 ONLINE       0     0     0
            r2c3                 ONLINE       0     0     0
            r3c3                 ONLINE       0     0     0
            r4c3                 ONLINE       0     0     0
            br0c0                ONLINE       0     0     0
            br1c0                ONLINE       0     0     0
            br2c0                ONLINE       0     0     0
            br0c1                ONLINE       0     0     0
            br1c1                ONLINE       0     0     0
            br2c1                ONLINE       0     0     0

errors: No known data errors

/dev/sdai1 在线，raidcontroller 没有显示任何错误（甚至没有媒体错误）。我可以尝试使磁盘联机/脱机吗？

更新：我试图分离磁盘但它拒绝这样做，我的印象是 raidz2-0 有 2 个奇偶校验磁盘（并且 raidz2-1 也有 2 个）所以我为什么不能分离？

zpool detach data 7196084230607724634
cannot detach 7196084230607724634: only applicable to mirror and replacing vdevs

我们有一个 VPS（2GB RAM/2 个 vCPU）。那是服务于 PHP 5.6、Centos 6、Apache 2.2 的 phpBB 论坛。但是有时论坛的响应速度非常慢。使用 Chrome 网络浏览器，我发现 TTFB 有时会达到 30 秒。奇怪的是，缓存项目也有这个问题。（见截图）

我已经尝试过：

• 问题期间服务器的负载不高于 0.20，并且有可用内存。

• 我 ping 了服务器：大约 10 毫秒

• 安装 zend opcache (99.9% 点击)

• 安装 memcached (统计)

• 我安装了 mytop 以查看 MySQL 是否有问题，但据我了解 MySQL 并没有做太多

  查询：6.0M qps：26 慢速：4.0 Se/In/Up/De(%)：75/02/08/01 qps 现在：2 慢速 qps：0.0 线程：1 ( 1/ 0) 00/00/00/ 00 键效率：99.4% Bps 输入/输出：4.4k/51.1k 现在输入/输出：48.4/7.5k

由于情况并非总是如此，因此复制此问题的唯一方法是向 F5 发送垃圾邮件，尽管我不确定这是否真的复制了问题。我可以在较小的扩展（2s ttfb）中复制它与在 html 中复制的相同页面（删除动态部分）。

http://s21.postimg.org/ql6eywn3b/ttfb.png

我有keepalive（最大100，15秒​​），maxclients 30。我从这里去哪里？

我们的存储服务器有问题，它有一段时间没有更新，所以我们尝试更新它，但在更新过程中（它需要一些 2k 包更新）它完全黑了。（主板上没有屏幕，ssh 死了，但磁盘上仍有一些 io：闪烁的 LED）

我们重新启动机器以查看发生了什么。启动失败，我们收到此错误：

Server fails to boot with lvm error : ¨Invalid argument for --available: ay Error during parsing of command line.¨

我能找到的唯一解决方案是在 redhat 知识库上，并受到付费墙的保护 :(

我已验证 root (ext4) 和 home (ext4) 上的所有数据都正常，可以使用救援磁盘访问。我也可以安装这些并获得访问权限。所以我很确定这是一个配置错误。但是我不知道如何解决它。

这是在 centos 6 机器上运行的，它说（etc/redhat-release）它的 6.7 但我认为它更旧，而 6.7 是升级版本。

我不确定它在这种情况下是否有用，但我转储了 (grep -v '#') 配置/etc/lvm/lvm.conf

所以 ZFS 报告了一些“读取问题”，所以看起来这个磁盘出现了故障，基于我们知道的ZFS-8000-9P文档报告中没有给出任何内容的事实。这些磁盘相当新，我们最近遇到的唯一问题是完整的 ZFS。

ZFS 在LSI MegaRAID 9271-8i 之上运行，所有磁盘在每个磁盘上运行“raid 0”。我对这个raid卡不是很熟悉，所以我找到了一个脚本，它返回从megacli命令行工具派生的数据。我添加了 1 个驱动器来显示设置，它们的设置都相同。（系统盘不同）

zpool 状态输出

  pool: data
 state: ONLINE
status: One or more devices has experienced an unrecoverable error.  An
        attempt was made to correct the error.  Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
        using 'zpool clear' or replace the device with 'zpool replace'.
   see: http://zfsonlinux.org/msg/ZFS-8000-9P
  scan: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        data        ONLINE       0     0     0
          raidz2-0  ONLINE       0     0     0
            br0c2   ONLINE       0     0     0
            br1c2   ONLINE       0     0     0
            br2c2   ONLINE       0     0     0
            br0c3   ONLINE       0     0     0
            br1c3   ONLINE       0     0     0
            br2c3   ONLINE       0     0     0
            r2c1    ONLINE       0     0     0
            r1c2    ONLINE       0     0     0
            r5c3    ONLINE       0     0     0
            sdb     ONLINE       0     0     0
            sdc     ONLINE       0     0     0
            sdd     ONLINE       0     0     0
            sde     ONLINE       0     0     0
            sdf     ONLINE       0     0     0
            sdg     ONLINE       0     0     0
            r3c1    ONLINE       0     0     0
            r4c1    ONLINE       2     0     0
... cut raidz2-1 ...
errors: No known data errors

LSI 脚本的输出

Virtual Drive: 32 (Target Id: 32)
Name                :
RAID Level          : Primary-0, Secondary-0, RAID Level Qualifier-0
Size                : 3.637 TB
Sector Size         : 512
Is VD emulated      : No
Parity Size         : 0
State               : Optimal
Strip Size          : 512 KB
Number Of Drives    : 1
Span Depth          : 1
Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU
Current Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU
Default Access Policy: Read/Write
Current Access Policy: Read/Write
Disk Cache Policy   : Disk's Default
Encryption Type     : None
PI type: No PI

Is VD Cached: No

该脚本不报告任何故障磁盘，raidcontroller 也不将驱动器标记为故障。我发现了一些其他主题zpool error给出了清除错误并运行清理的建议。现在我的问题是，运行擦洗的阈值是什么时候，这需要多长时间（假设这个 zfs RAID 运行擦洗会对性能造成影响）此外，当这个磁盘真的很糟糕时，热插拔是否会初始化一个“重建” ? 所有磁盘都是“Western Digital RE 4TB, SAS II, 32MB, 7200rpm, enterprise 24/7/365”。是否有系统可以检查 zfs 错误，因为这只是例行手动检查？

zfs 版本：0.6.4.1 zfsonlinux

我知道没有分配 2 个读取错误，但我更愿意早点更换磁盘到晚点。

概述情况：

• 一堆服务器（约 15 个从 4u 到 1u，一些冗余 PSU 一些单个）
• 2 UPS（我可以使用 apcupsd 读取 1 APC）
• 2个配电单元

所以我遇到了这种情况，老实说，我不知道最好的解决方案是什么。我们目前已将大部分服务器（甚至是冗余 PSU）放在 1 台 UPS 上（较旧的一台，没有 APC）然后当我们开始从中汲取太多汁液时，它开始抱怨，他们又买了一台，并更换了可能最大的电源新 UPS (APC) 上的饥饿服务器（集群）

我不介意服务器在停电期间脱机，我希望它们在 UPS 断电之前就停止运行。目前，服务器一直运行，直到它们不再获得任何电力，然后痛苦地死去。

因此，合理的情况是我们对可以执行的服务器进行重复数据删除，以便他们从每个 UPS 中提取 50/50（尽可能）。但是，在断电期间，其中一个电池会在另一个电池之前用完，这会导致所有服务器从另一个 UPS 中汲取汁液，可能会拉出大量电力并导致瞬间断电？

所以我的问题是 PSU 从每个电源中提取 50% 的电量吗？以及我如何（如果需要使用新硬件）解决这种情况。当您从 UPS 拉出太多东西时，最糟糕的情况是什么？

我想保护服务器免受电力高峰和<5分钟的短暂中断。超出这个时间范围的任何事情都可以在阶梯上解释。或者服务器配置正常，我们知道如果认为有必要，它们可以重新启动。