Steve's picture

Review of PVFS2 (2.8.2)

I read a review of a few parallel file systems the other day (I tried to find the link and couldn't find it, sorry), but it suggested PVFS, Lustre and GlusterFS. I had used PVFS back in the 1.0-days and thought that it was worth trying again.

I installed 8 vmware instances of Ubuntu 9.10 on a machine that I had lying around and started compiling PVFS. I got the server running on all 8 instances and got the kernel module running on one node, so I had a real, mountable filesystem. I'm not sure how to measure performance because it's all done in a virtual machine on a 100Mbps network in my home, but I was surprised to find that PVFS was not fault tolerant if/when I took a machine down. What?

I dug through the docs and it turns out that PVFS is only fault tolerant for the server if shared storage is available and it uses heartbeat to do the failover, so the 'server' is fault tolerant, but the file system isn't if we lose a machine or harddrive. Bummer.

Oh well. So much for PVFS. Although it has matured quite a lot since the 1.0 days, it's still not a 'redundant' solution if you need replication and want to design around storage hardware failures.

Steve's picture

SysAdmin John McCain!

http://xkcd.com/705/

Steve's picture

Why your employees are losing motivation

Taken from "Stop Demotivating Your Employees!" Harvard Management Update, Vol. 11, No. 1, January 2006

Most companies have it all wrong. They don't have to motivate their employees. They have to stop demotivating them.

The great majority of employees are quite enthusiastic when they start a new job. But in about 85 percent of companies, our research finds, employees' morale sharply declines after their first six months—and continues to deteriorate for years afterward. That finding is based on surveys of about 1.2 million employees at 52 primarily Fortune 1000 companies from 2001 through 2004, conducted by Sirota Survey Intelligence (Purchase, New York).

The fault lies squarely at the feet of management—both the policies and procedures companies employ in managing their workforces and in the relationships that individual managers establish with their direct reports.

Three key goals of people at work

To maintain the enthusiasm employees bring to their jobs initially, management must understand the three sets of goals that the great majority of workers seek from their work—and then satisfy those goals:

* Equity: To be respected and to be treated fairly in areas such as pay, benefits, and job security.
* Achievement: To be proud of one's job, accomplishments, and employer.
* Camaraderie: To have good, productive relationships with fellow employees.

To maintain an enthusiastic workforce, management must meet all three goals. Indeed, employees who work for companies where just one of these factors is missing are three times less enthusiastic than workers at companies where all elements are present.

One goal cannot be substituted for another. Improved recognition cannot replace better pay, money cannot substitute for taking pride in a job well done, and pride alone will not pay the mortgage.

What individual managers can do

Steve's picture

Why I hate java

This is a re-post from my old webpage back in 2000:

(from C/C++ Users Journal):

Reasons we prefer C to Java in two words - transparency and control:

* In C, an array of structs will be laid out contiguously in memory, which is good for cache locality. In Java, the decision of how to lay out an array of objects is made by the compiler, and probably has indirections.
* C has data types that match hardware data types and operations. Java abstracts from the hardware ("write once, run anywhere").
* C has manual memory management, whereas Java has garbage collection. Garbage collection is safe and convenient, but places little control over performance in the hands of programmers, and indeed encourages an allocation-intensive style.

In short, C programmers can see the costs of their programs simply by looking at them, and they can easily change data representations and fundamental strategies such as memory management. It's easy for C programmers to tune their code for performance or for resource constraints.

I could go on and on, but here's just the google search for "Java sucks": http://www.google.com/search?q=java+sucks&ie=utf-8&oe=utf-8&aq=t&rls=org...
Disclaimer: I was taught programming using Pascal, then C, then C++. I'm used to programming "close to the metal". I use PHP and Perl when needed, but steer clear of Java at almost all costs. I don't even like using java applications whenever possible - not because of principal, but because of poor performance or resource hogging. What do you use uTorrent (C) or Azurus (Java)? Why aren't operating systems written in Java? Most anything that needs good performance is written in C or assembly to squeeze as much out of the hardware as possible.

Steve's picture

Finished my "last search" plugins

A while ago, I had an idea about search. What if a search engine recorded the last hit that you went to off the search results page and used those urls as the most popular results from that page? The theory is that once you find what you're searching for, you stop searching for it, aka - you don't go back to the search engine anymore. So, the last link that you click on from the search page should be the one you wanted. If enough people click on the same link, that link should be the most popular and should be at the top of the page.

I wrote two greasemonkey plugins. One that allows a user to submit results to the study and one that queries the study database for results. They can be found here:

http://userscripts.org/scripts/show/31639
http://userscripts.org/scripts/show/64039

You'll need to be running firefox and install the greasemonkey plugin https://addons.mozilla.org/en-US/firefox/addon/748 first in order to install the above scripts. Once everything's installed, you're part of the project!



Steve's picture

Amazon needs a mysql replication/snapshot service

Amazon has EC2, S3, their key/value database, their mysql service and about a jillion other great services and tools, but what I think would be awesome and not hard for them to do is to just have a replication/snapshotting service for mysql - a backup.

In mysql, it's very easy to just point a slave at a master mysql server. Just give it an IP, name, password and a pointer into the transaction log. How nice would it be to just point your mysql server at an Amazon IP and know that it's now being replicated, backed up and snapshotted at regular intervals? Instant Mysql backups! A one-liner on your side configuration-wise and your whole database is being backed up? How awesome is that!?!?!? It would be pretty simple for Amazon to put together, just another EC2 instance and they could charge the normal rates and get some more business. Making this easy would inspire many people to use it and could bring in some instant revenue to 'the Zon' in my opinion.

Steve's picture

Why git is faster than jgit

The author of jgit shows why C is so much faster than Java when comparing his version of jgit to the original C version.
http://marc.info/?l=git&m=124111702609723&w=2

Steve's picture

2009 Christmas Stream is up

The annual Christmas stream is working again! Let the holiday season begin!

The url: http://badcheese.com:8000/stream

This year I'm using an icecast streamer from my new web host in Florida.

Compatible clients:

itunes (ctrl-U, then type in the url)
fstream (free for the iphone)
foobar2000 http://www.foobar2000.org
winamp http://www.winamp.com
XMMS http://www.xmms.org
Zinf http://zinf.sourceforge.net
MPlayer http://www.mplayerhq.hu
Xine http://www.xinehq.de
VLC http://www.videolan.org

- Steve

Syndicate content