Skip to main content

Thread: Trying to figure out what went wrong


our website went down on christmas, i'm in today doing post-mortem on server, speak. got site half-up, having problems, , don't know error codes enough not gobbledygook. theory @ moment mysql database corrupted due sectors of hard drive failing, but...

syslog:


code:
dec 28 06:37:10 www kernel: [594901.898204] ata2.00: configured udma/133  dec 28 06:37:10 www kernel: [594901.898220] sd 1:0:0:0: [sda] result: hostbyte=did  _ok driverbyte=driver_sense,suggest_ok  dec 28 06:37:10 www kernel: [594901.898229] sd 1:0:0:0: [sda] sense key : medium e  rror [current] [descriptor]  dec 28 06:37:10 www kernel: [594901.898238] descriptor sense data sense descr  iptors (in hex):  dec 28 06:37:10 www kernel: [594901.898269]         72 03 11 04 00 00 00 0c 00 0a   80 00 00 00 00 00   dec 28 06:37:10 www kernel: [594901.898340]         06 8f d6 9f   dec 28 06:37:10 www kernel: [594901.898374] sd 1:0:0:0: [sda] add. sense: unrecove  red read error - auto reallocate failed  dec 28 06:37:10 www kernel: [594901.898385] end_request: i/o error, dev sda, secto  r 110089887  dec 28 06:37:10 www kernel: [594901.898401] ata2: eh complete  dec 28 06:37:10 www kernel: [594901.898662] sd 1:0:0:0: [sda] 156250000 512-byte h  ardware sectors (80000 mb)  dec 28 06:37:10 www kernel: [594901.923322] sd 1:0:0:0: [sda] write protect off  dec 28 06:37:10 www kernel: [594901.923328] sd 1:0:0:0: [sda] mode sense: 00 3a 00   00  dec 28 06:37:10 www kernel: [594901.925206] sd 1:0:0:0: [sda] write cache: enabled  , read cache: enabled, doesn't support dpo or fua  dec 28 06:37:10 www kernel: [594901.935124] sd 1:0:0:0: [sda] 156250000 512-byte h  ardware sectors (80000 mb)  dec 28 06:37:10 www kernel: [594901.935312] sd 1:0:0:0: [sda] write protect off  dec 28 06:37:10 www kernel: [594901.935318] sd 1:0:0:0: [sda] mode sense: 00 3a 00   00  dec 28 06:37:10 www kernel: [594901.959755] sd 1:0:0:0: [sda] write cache: enabled  , read cache: enabled, doesn't support dpo or fua  dec 28 06:37:12 www kernel: [594903.702453] ata2.00: exception emask 0x0 sact 0x0   serr 0x0 action 0x0  dec 28 06:37:12 www kernel: [594903.702479] ata2.00: bmdma stat 0x24  dec 28 06:37:12 www kernel: [594903.702508] ata2.00: cmd c8/00:08:ff:e2:8f/00:00:0  0:00:00/e6 tag 0 dma 4096 in  dec 28 06:37:12 www kernel: [594903.702513]          res 51/40:00:ff:e2:8f/00:00:0  0:00:00/e6 emask 0x9 (media error)  dec 28 06:37:12 www kernel: [594903.702551] ata2.00: status: { drdy err }  dec 28 06:37:12 www kernel: [594903.702572] ata2.00: error: { unc }  dec 28 06:37:12 www kernel: [594903.894785] ata2.00: configured udma/133  dec 28 06:37:12 www kernel: [594903.894798] ata2: eh complete  dec 28 06:37:14 www kernel: [594905.216354] ata2.00: exception emask 0x0 sact 0x0   serr 0x0 action 0x0  dec 28 06:37:14 www kernel: [594905.216376] ata2.00: bmdma stat 0x24  dec 28 06:37:14 www kernel: [594905.216402] ata2.00: cmd c8/00:08:ff:e2:8f/00:00:0  0:00:00/e6 tag 0 dma 4096 in  dec 28 06:36:12 www kernel: [594759.720703] ata2.00: exception emask 0x0 sact 0x0   serr 0x0 action 0x0  dec 28 06:36:22 www kernel: [594759.720730] ata2.00: bmdma stat 0x24  dec 28 06:36:22 www kernel: [594759.720759] ata2.00: cmd c8/00:18:7f:d3:8f/00:00:0  0:00:00/e6 tag 0 dma 12288 in  dec 28 06:36:22 www kernel: [594759.720762]          res 51/40:00:7f:d3:8f/00:00:0  0:00:00/e6 emask 0x9 (media error)
seemed loop there. also, when trying run
code:
mysqld start
code:
111228 11:18:10 [note] plugin 'federated' disabled.  111228 11:18:10  innodb: initializing buffer pool, size = 8.0m  111228 11:18:10  innodb: completed initialization of buffer pool  innodb: error: tried read 512 bytes @ offset 0 512.  innodb: able read -1.  111228 11:18:19  innodb: operating system error number 5 in file operation.  innodb: error number 5 means 'input/output error'.  innodb: operating system error numbers described @  innodb: http://dev.mysql.com/doc/refman/5.1/en/operating-system-error-codes.html  innodb: file operation call: 'read'.  innodb: cannot continue operation.
do think i'm on right track? suggestions on do?

looks failed hard drive. have run smartmontools against it? assume have code , database backed up. if so, i'd throw in new hard drive , reinstalling os. if don't have backup, you'll want try gddrescue, or other recovery tool.


Forum The Ubuntu Forum Community Ubuntu Specialised Support Ubuntu Servers, Cloud and Juju Server Platforms [SOLVED] Trying to figure out what went wrong


Ubuntu

Comments