[FUG-BR] Servidores re-iniciando sem motivo aparente

Marcelo Gondim gondim em bsdinfo.com.br
Sexta Agosto 12 15:58:53 BRT 2011


Buenas pessoal,

Tem acontecido algumas coisas estranhas com os 3 servidores FreeBSD que 
tenho que agem como gateways. Depois de alguns dias em uso eles 
simplesmente re-iniciam. Nos logs não consta nada. O trecho abaixo 
mostra isso:

Aug 11 06:07:04 seca sudo:      www : TTY=unknown ; PWD=/var/www/intnet 
; USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.173.4
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.171.10
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T add 192.168.171.10
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.171.16
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T add 192.168.171.16
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.171.28
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T add 192.168.171.28
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.171.35
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T add 192.168.171.35
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.173.3
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T add 192.168.173.3
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.173.61
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T add 192.168.173.61
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 192.168.173.4
Aug 11 06:30:33 seca sudo:     root : TTY=unknown ; PWD=/root ; 
USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T add 192.168.173.4
Aug 11 06:31:43 seca sudo:      www : TTY=unknown ; PWD=/var/www/intnet 
; USER=root ; COMMAND=/bin/sh -c pfctl -t bloqueados -T delete 
192.168.171.10
Aug 11 06:40:36 seca syslogd: kernel boot file is /boot/kernel/kernel
Aug 11 06:40:36 seca kernel: Copyright (c) 1992-2011 The FreeBSD Project.
Aug 11 06:40:36 seca kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 
1989, 1991, 1992, 1993, 1994
Aug 11 06:40:36 seca kernel: The Regents of the University of 
California. All rights reserved.
Aug 11 06:40:36 seca kernel: FreeBSD is a registered trademark of The 
FreeBSD Foundation.
Aug 11 06:40:36 seca kernel: FreeBSD 8.2-STABLE #1: Fri Jul 22 15:58:18 
BRT 2011
Aug 11 06:40:36 seca kernel: 
root em seca.intnet.com.br:/usr/obj/usr/src/sys/INTNET amd64
Aug 11 06:40:36 seca kernel: Timecounter "i8254" frequency 1193182 Hz 
quality 0
Aug 11 06:40:36 seca kernel: CPU: Intel(R) Core(TM) i3 CPU         530  
@ 2.93GHz (2926.02-MHz K8-class CPU)
Aug 11 06:40:36 seca kernel: Origin = "GenuineIntel"  Id = 0x20652  
Family = 6  Model = 25  Stepping = 2
Aug 11 06:40:36 seca kernel: 
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Aug 11 06:40:36 seca kernel: 
Features2=0x98e3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT>
Aug 11 06:40:36 seca kernel: AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
Aug 11 06:40:36 seca kernel: AMD Features2=0x1<LAHF>

Vinha funcionando normal até às 06:31:43 quando re-iniciou e às 06:40:36 
começou à carregar o kernel novamente. No início suspeitei de nobreak 
mas o estranho é que os outros servidores que estão no mesmo nobreak não 
re-iniciaram. No last não apresentou nada:

suporte          pts/5    10.255.0.12      Thu Aug 11 09:18 - 09:27  (00:08)
suporte          pts/4    10.255.0.12      Thu Aug 11 08:30 - 12:07  (03:37)
suporte          pts/3    10.255.0.12      Thu Aug 11 08:14 - 17:32  (09:17)
suporte          pts/2    10.255.0.12      Thu Aug 11 08:14 - 18:00  (09:45)
suporte          pts/1    10.255.0.12      Thu Aug 11 08:13 - 17:34  (09:20)
suporte          pts/0    10.255.0.12      Thu Aug 11 08:12 - 22:04  (13:52)
reboot           ~                         Thu Aug 11 06:41
pauloborges      ftp      ::ffff:172.31.0  Wed Aug 10 18:25 - 18:26  (00:01)
pauloborges      ftp      ::ffff:172.31.0  Wed Aug 10 18:08 - 18:09  (00:01)
pauloborges      ftp      ::ffff:172.31.0  Wed Aug 10 18:08 - 18:08  (00:00)
pauloborges      ftp      ::ffff:172.31.0  Wed Aug 10 17:40 - 17:41  (00:01)
pauloborges      ftp      ::ffff:172.31.0  Wed Aug 10 17:40 - 17:40  (00:00)
suporte          pts/4    10.255.0.12      Wed Aug 10 17:26 - 17:55  (00:29)

Abaixo vai o meu dmesg completo. O sistema é checado todos os dias e as 
atualizações de segurança que saem são feitas também. Alguém já passou 
por algo parecido?

Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
         The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #1: Fri Jul 22 15:58:18 BRT 2011
     root em seca.intnet.com.br:/usr/obj/usr/src/sys/INTNET amd64
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Core(TM) i3 CPU         530  @ 2.93GHz (2926.02-MHz 
K8-class CPU)
   Origin = "GenuineIntel"  Id = 0x20652  Family = 6  Model = 25  
Stepping = 2
   
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
   
Features2=0x98e3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT>
   AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
   AMD Features2=0x1<LAHF>
   TSC: P-state invariant
real memory  = 4294967296 (4096 MB)
avail memory = 3822972928 (3645 MB)
ACPI APIC Table: <042910 APIC2154>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 SMT threads
  cpu0 (BSP): APIC ID:  0
  cpu1 (AP): APIC ID:  1
  cpu2 (AP): APIC ID:  4
  cpu3 (AP): APIC ID:  5
ioapic0: Changing APIC ID to 6
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <\M^?\M^?\M^?\M^?\M^?\M^? \M^?\M^?\M^?\M^?\M^?\M^?\M^?\M^?> on 
motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, b7f00000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
ACPI Warning: Incorrect checksum in table [OEMB] - 0x9D, should be 0x9C 
(20101013/tbutils-354)
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
em0: <Intel(R) PRO/1000 Network Connection 7.2.3> port 0xdc00-0xdc1f mem 
0xfbee0000-0xfbefffff,0xfbe00000-0xfbe7ffff,0xfbedc000-0xfbedffff irq 16 
at device 0.0 on pci1
em0: Using MSIX interrupts with 3 vectors
em0: [ITHREAD]
em0: [ITHREAD]
em0: [ITHREAD]
em0: Ethernet address: 00:1b:21:9d:4b:68
vgapci0: <VGA-compatible display> port 0xcc00-0xcc07 mem 
0xfb800000-0xfbbfffff,0xd0000000-0xdfffffff irq 16 at device 2.0 on pci0
agp0: <Intel Ironlake (D) SVGA controller> on vgapci0
agp0: aperture size is 256M, detected 65532k stolen memory
pci0: <simple comms> at device 22.0 (no driver attached)
ehci0: <Intel PCH USB 2.0 controller USB-B> mem 0xfbdf8000-0xfbdf83ff 
irq 16 at device 26.0 on pci0
ehci0: [ITHREAD]
usbus0: EHCI version 1.0
usbus0: <Intel PCH USB 2.0 controller USB-B> on ehci0
pci0: <multimedia, HDA> at device 27.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
em1: <Intel(R) PRO/1000 Network Connection 7.2.3> port 0xec00-0xec1f mem 
0xfbfe0000-0xfbffffff,0xfbf00000-0xfbf7ffff,0xfbfdc000-0xfbfdffff irq 16 
at device 0.0 on pci2
em1: Using MSIX interrupts with 3 vectors
em1: [ITHREAD]
em1: [ITHREAD]
em1: [ITHREAD]
em1: Ethernet address: 00:1b:21:9d:4a:cb
ehci1: <Intel PCH USB 2.0 controller USB-A> mem 0xfbdf2000-0xfbdf23ff 
irq 23 at device 29.0 on pci0
ehci1: [ITHREAD]
usbus1: EHCI version 1.0
usbus1: <Intel PCH USB 2.0 controller USB-A> on ehci1
pcib3: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci3: <ACPI PCI bus> on pcib3
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 5 Series/3400 Series PCH SATA300 controller> port 
0xc880-0xc887,0xc800-0xc803,0xc480-0xc487,0xc400-0xc403,0xc080-0xc09f 
mem 0xfbdf0000-0xfbdf07ff irq 19 at device 31.2 on pci0
atapci0: [ITHREAD]
atapci0: AHCI called from vendor specific driver
atapci0: AHCI v1.30 controller with 6 3Gbps ports, PM not supported
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci0
ata4: [ITHREAD]
ata5: <ATA channel 3> on atapci0
ata5: [ITHREAD]
ata6: <ATA channel 4> on atapci0
ata6: [ITHREAD]
ata7: <ATA channel 5> on atapci0
ata7: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on 
acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
orm0: <ISA Option ROM> at iomem 0xce800-0xcf7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
Timecounters tick every 1.000 msec
IPsec: Initialized Security Association Processing.
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, rule-based 
forwarding enabled, default to accept, logging disabled
DUMMYNET 0 with IPv6 initialized (100409)
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ad4: 476940MB <SAMSUNG HD502HJ 1AJ10002> at ata2-master UDMA100 SATA 3Gb/s
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #2 Launched!
ugen1.1: <Intel> at usbus1ugen0.1: <Intel> at usbus0

uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
Root mount waiting for: usbus1 usbus0
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
Root mount waiting for: usbus1 usbus0
ugen1.2: <vendor 0x8087> at usbus1
uhub2: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2> 
on usbus1
ugen0.2: <vendor 0x8087> at usbus0
uhub3: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2> 
on usbus0
uhub2: 6 ports with 6 removable, self powered
uhub3: 6 ports with 6 removable, self powered
Root mount waiting for: usbus1
ugen1.3: <vendor 0x04d9> at usbus1
ukbd0: <vendor 0x04d9 product 0x1203, class 0/0, rev 2.00/2.80, addr 3> 
on usbus1
kbd2 at ukbd0
uhid0: <vendor 0x04d9 product 0x1203, class 0/0, rev 2.00/2.80, addr 3> 
on usbus1
Root mount waiting for: usbus1
ugen1.4: <vendor 0x05e3> at usbus1
uhub4: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/9.01, addr 4> on 
usbus1
uhub4: 4 ports with 4 removable, self powered
Root mount waiting for: usbus1
ugen1.5: <Prolific Technology Inc.> at usbus1
uplcom0: <Prolific Technology Inc. USB-Serial Controller, class 0/0, rev 
1.10/3.00, addr 5> on usbus1
Root mount waiting for: usbus1
ugen1.6: <Prolific Technology Inc.> at usbus1
uplcom1: <Prolific Technology Inc. USB-Serial Controller, class 0/0, rev 
1.10/3.00, addr 6> on usbus1
Trying to mount root from ufs:/dev/ad4s1a
WARNING: / was not properly dismounted
WARNING: /tmp was not properly dismounted
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted
em1: link state changed to UP
em0: link state changed to UP
tun0: link state changed to UP

FreeBSD seca.localdomain 8.2-STABLE FreeBSD 8.2-STABLE #1: Fri Jul 22 
15:58:18 BRT 2011     root em seca.localdomain:/usr/obj/usr/src/sys/INTNET  
amd64


Mais detalhes sobre a lista de discussão freebsd