2014-10-07 14:06:19 +00:00
<?xml version="1.0" encoding="utf-8"?>
< !DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
< html xmlns = "http://www.w3.org/1999/xhtml" lang = "en" xml:lang = "en" >
< head >
< title > Server Log: tilde.club< / title >
2014-10-07 14:07:27 +00:00
<!-- 2014 - 10 - 07 Tue 10:07 -->
2014-10-07 14:06:19 +00:00
< meta http-equiv = "Content-Type" content = "text/html;charset=utf-8" / >
< meta name = "generator" content = "Org-mode" / >
< meta name = "author" content = "Paul Ford" / >
< style type = "text/css" >
<!-- /* --> <![CDATA[/*> <!-- */
.title { text-align: center; }
.todo { font-family: monospace; color: red; }
.done { color: green; }
.tag { background-color: #eee; font-family: monospace;
padding: 2px; font-size: 80%; font-weight: normal; }
.timestamp { color: #bebebe; }
.timestamp-kwd { color: #5f9ea0; }
.right { margin-left: auto; margin-right: 0px; text-align: right; }
.left { margin-left: 0px; margin-right: auto; text-align: left; }
.center { margin-left: auto; margin-right: auto; text-align: center; }
.underline { text-decoration: underline; }
#postamble p, #preamble p { font-size: 90%; margin: .2em; }
p.verse { margin-left: 3%; }
pre {
border: 1px solid #ccc;
box-shadow: 3px 3px 3px #eee;
padding: 8pt;
font-family: monospace;
overflow: auto;
margin: 1.2em;
}
pre.src {
position: relative;
overflow: visible;
padding-top: 1.2em;
}
pre.src:before {
display: none;
position: absolute;
background-color: white;
top: -10px;
right: 10px;
padding: 3px;
border: 1px solid black;
}
pre.src:hover:before { display: inline;}
pre.src-sh:before { content: 'sh'; }
pre.src-bash:before { content: 'sh'; }
pre.src-emacs-lisp:before { content: 'Emacs Lisp'; }
pre.src-R:before { content: 'R'; }
pre.src-perl:before { content: 'Perl'; }
pre.src-java:before { content: 'Java'; }
pre.src-sql:before { content: 'SQL'; }
table { border-collapse:collapse; }
caption.t-above { caption-side: top; }
caption.t-bottom { caption-side: bottom; }
td, th { vertical-align:top; }
th.right { text-align: center; }
th.left { text-align: center; }
th.center { text-align: center; }
td.right { text-align: right; }
td.left { text-align: left; }
td.center { text-align: center; }
dt { font-weight: bold; }
.footpara:nth-child(2) { display: inline; }
.footpara { display: block; }
.footdef { margin-bottom: 1em; }
.figure { padding: 1em; }
.figure p { text-align: center; }
.inlinetask {
padding: 10px;
border: 2px solid gray;
margin: 10px;
background: #ffffcc;
}
#org-div-home-and-up
{ text-align: right; font-size: 70%; white-space: nowrap; }
textarea { overflow-x: auto; }
.linenr { font-size: smaller }
.code-highlighted { background-color: #ffff00; }
.org-info-js_info-navigation { border-style: none; }
#org-info-js_console-label
{ font-size: 10px; font-weight: bold; white-space: nowrap; }
.org-info-js_search-highlight
{ background-color: #ffff00; color: #000000; font-weight: bold; }
/*]]>*/-->
< / style >
< script type = "text/javascript" >
/*
@licstart The following is the entire license notice for the
JavaScript code in this tag.
Copyright (C) 2012-2013 Free Software Foundation, Inc.
The JavaScript code in this tag is free software: you can
redistribute it and/or modify it under the terms of the GNU
General Public License (GNU GPL) as published by the Free Software
Foundation, either version 3 of the License, or (at your option)
any later version. The code is distributed WITHOUT ANY WARRANTY;
without even the implied warranty of MERCHANTABILITY or FITNESS
FOR A PARTICULAR PURPOSE. See the GNU GPL for more details.
As additional permission under GNU GPL version 3 section 7, you
may distribute non-source (e.g., minimized or compacted) forms of
that code without the copy of the GNU GPL normally required by
section 4, provided you include this license notice and a URL
through which recipients can access the Corresponding Source.
@licend The above is the entire license notice
for the JavaScript code in this tag.
*/
<!-- /* --> <![CDATA[/*> <!-- */
function CodeHighlightOn(elem, id)
{
var target = document.getElementById(id);
if(null != target) {
elem.cacheClassElem = elem.className;
elem.cacheClassTarget = target.className;
target.className = "code-highlighted";
elem.className = "code-highlighted";
}
}
function CodeHighlightOff(elem, id)
{
var target = document.getElementById(id);
if(elem.cacheClassElem)
elem.className = elem.cacheClassElem;
if(elem.cacheClassTarget)
target.className = elem.cacheClassTarget;
}
/*]]>*///-->
< / script >
< / head >
< body >
< div id = "content" >
< h1 class = "title" > Server Log: tilde.club< / h1 >
< div id = "table-of-contents" >
< h2 > Table of Contents< / h2 >
< div id = "text-table-of-contents" >
< ul >
2014-10-07 14:07:27 +00:00
< li > < a href = "#sec-1" > 1. Launch < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-01 Wed> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / a > < / li >
< li > < a href = "#sec-2" > 2. Crash < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-04 Sat> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / a >
2014-10-07 14:06:19 +00:00
< ul >
< li > < a href = "#sec-2-1" > 2.1. Notes< / a > < / li >
< li > < a href = "#sec-2-2" > 2.2. < span class = "done DONE" > DONE< / span > Resolution< / a > < / li >
< / ul >
< / li >
2014-10-07 14:07:27 +00:00
< li > < a href = "#sec-3" > 3. Backup < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-04 Sat> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / a > < / li >
< li > < a href = "#sec-4" > 4. Server Crash < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-07 Tue> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / a >
2014-10-07 14:06:19 +00:00
< ul >
< li > < a href = "#sec-4-1" > 4.1. Notes< / a > < / li >
< li > < a href = "#sec-4-2" > 4.2. < span class = "todo TODO" > TODO< / span > Resolution< / a > < / li >
< / ul >
< / li >
< / ul >
< / div >
< / div >
2014-10-07 14:07:27 +00:00
< p >
The org-mode parser on github doesn't understand lists, sadly. So a lot
of this file is invisible. View raw or check out the HTML output that is
also in this directory.
< / p >
2014-10-07 14:06:19 +00:00
< div id = "outline-container-sec-1" class = "outline-2" >
2014-10-07 14:07:27 +00:00
< h2 id = "sec-1" > < span class = "section-number-2" > 1< / span > Launch < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-01 Wed> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / h2 >
2014-10-07 14:06:19 +00:00
< div class = "outline-text-2" id = "text-1" >
< ul class = "org-ul" >
< li > I think this was the day it launched. I honestly can't remember.
< / li >
< / ul >
< / div >
< / div >
< div id = "outline-container-sec-2" class = "outline-2" >
2014-10-07 14:07:27 +00:00
< h2 id = "sec-2" > < span class = "section-number-2" > 2< / span > Crash < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-04 Sat> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / h2 >
2014-10-07 14:06:19 +00:00
< div class = "outline-text-2" id = "text-2" >
< / div > < div id = "outline-container-sec-2-1" class = "outline-3" >
< h3 id = "sec-2-1" > < span class = "section-number-3" > 2.1< / span > Notes< / h3 >
< div class = "outline-text-3" id = "text-2-1" >
< ul class = "org-ul" >
< li > Informed of problem via Twitter.
< / li >
< li > [Redacted] user wrote to say:
< / li >
< / ul >
< p >
#+BEGIN< sub > BLOCKQUOTE< / sub >
I put "bash" in my .bashrc (like the command, on a line). This seems incredibly stupid in retrospect but I was trying to get my shell to load my aliases and if I ran `bash` they did, so…
< / p >
< p >
Sorrrryryryhuetnaouemkb
< / p >
< p >
I'm going to put myself in an infinite loop of timeout
< / p >
< p >
(IF I'm allowed back on, which would be understood if I weren't)
#+END BLOCKQUOTE
< / p >
< / div >
< / div >
< div id = "outline-container-sec-2-2" class = "outline-3" >
< h3 id = "sec-2-2" > < span class = "section-number-3" > 2.2< / span > < span class = "done DONE" > DONE< / span > Resolution< / h3 >
< div class = "outline-text-3" id = "text-2-2" >
< ul class = "org-ul" >
< li > Rebooted server
< / li >
< li > Renamed bad .bashrc so that it would not execute when user logged in
< / li >
< / ul >
< / div >
< / div >
< / div >
< div id = "outline-container-sec-3" class = "outline-2" >
2014-10-07 14:07:27 +00:00
< h2 id = "sec-3" > < span class = "section-number-2" > 3< / span > Backup < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-04 Sat> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / h2 >
2014-10-07 14:06:19 +00:00
< div class = "outline-text-2" id = "text-3" >
< ul class = "org-ul" >
< li > Backed up < code > /var< / code > , < code > /etc< / code > , and < code > /home< / code > .
< / li >
< li > Saved to Paul Ford's home computer.
< / li >
< / ul >
< / div >
< / div >
< div id = "outline-container-sec-4" class = "outline-2" >
2014-10-07 14:07:27 +00:00
< h2 id = "sec-4" > < span class = "section-number-2" > 4< / span > Server Crash < span class = "timestamp-wrapper" > < span class = "timestamp" > < 2014-10-07 Tue> < / span > < / span >       < span class = "tag" > < span class = "PaulFord" > PaulFord< / span > < / span > < / h2 >
2014-10-07 14:06:19 +00:00
< div class = "outline-text-2" id = "text-4" >
< / div > < div id = "outline-container-sec-4-1" class = "outline-3" >
< h3 id = "sec-4-1" > < span class = "section-number-3" > 4.1< / span > Notes< / h3 >
< div class = "outline-text-3" id = "text-4-1" >
< ul class = "org-ul" >
< li > System log on AWS was last updated on Saturday, 10/4– at time of last bootup.
< / li >
< / ul >
< / div >
< / div >
< div id = "outline-container-sec-4-2" class = "outline-3" >
< h3 id = "sec-4-2" > < span class = "section-number-3" > 4.2< / span > < span class = "todo TODO" > TODO< / span > Resolution< / h3 >
< div class = "outline-text-3" id = "text-4-2" >
< ol class = "org-ol" >
< li > Rebooted the Server
< ul class = "org-ul" >
< li > This did not work and system log did not clear out or update.
< / li >
< li > While this was going on I received an email from Amazon letting me
know that the server would be retired on October 21st. This appears
to be unrelated to this current issue but definitely confused me.
< / li >
< li > FAILED.
< / li >
< / ul >
< / li >
< li > Made a snapshot of the EBS volume attached to tilde.club
< ul class = "org-ul" >
< li > Launched a new instance based on that EBS
< / li >
< li > Kernel panic; see < a href = "./server-logs/2014-10-07.txt" > ./server-logs/2014-10-07.txt< / a >
< / li >
< li > I'm not sure if this is me or the disk, though.
< / li >
< li > I'm getting
< ul class = "org-ul" >
< li > < code > Using IPI No-Shortcut mode< / code >
< / li >
< li > < code > XENBUS: Timeout connecting to devices!< / code >
< / li >
< li > < code > md: Autodetecting RAID arrays.< / code >
< / li >
< li > < code > md: autorun ...< / code >
< / li >
< li > < code > md: ... autorun DONE.< / code >
< / li >
< li > < code > Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(8,1)< / code >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li > Tried to look at the volume
< ul class = "org-ul" >
< li > Made a new instance
< / li >
< li > Made a new volume based on the snapshot
< / li >
< li > Tried to mount it
< / li >
< li > The volume identifies as GRUB
< / li >
< li > It's not a single volume, then, it's a filesystem with multiple volumes
< / li >
< li > I'm not sure how to attach whole filesystems as EBS volumes
< / li >
< / ul >
< / li >
< / ol >
< / div >
< / div >
< / div >
< / div >
< div id = "postamble" class = "status" >
< p class = "author" > Author: Paul Ford< / p >
2014-10-07 14:07:27 +00:00
< p class = "date" > Created: 2014-10-07 Tue 10:07< / p >
2014-10-07 14:06:19 +00:00
< p class = "creator" > < a href = "http://www.gnu.org/software/emacs/" > Emacs< / a > 24.4.50.1 (< a href = "http://orgmode.org" > Org< / a > mode 8.0)< / p >
< p class = "validation" > < a href = "http://validator.w3.org/check?uri=referer" > Validate< / a > < / p >
< / div >
< / body >
< / html >