email: bigwebb@gmail.com for changes to this service

#archivebox 2011-08-08 :: 2011-08-07 :: 2011-08-06 :: 2011-08-05 :: 2011-08-04 :: 2011-08-03 :: 2011-08-02 :: 2011-08-01 :: 2011-07-31 :: 2011-07-30 ::
#archiveteam 2013-05-25 :: 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 ::
#archiveteam-bs 2013-05-25 :: 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 ::
#archiveteam-twitter 2013-05-25 :: 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 ::
#flickrfckr 2013-05-04 :: 2013-04-21 :: 2013-04-10 :: 2013-03-27 :: 2013-02-23 :: 2013-02-11 :: 2013-02-09 :: 2013-02-02 :: 2013-01-25 :: 2013-01-24 ::
#urlteam 2013-05-25 :: 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 ::
#warrior 2013-05-25 :: 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 ::
#wikiteam 2013-05-25 :: 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 ::
Jul_13_2012_00:05:23underscorhttp://imgur.com/gallery/qleuW
Jul_13_2012_00:05:29arkhiveSchbirid: How did you set up your server to help AT? And how much are you paying a month?
Jul_13_2012_00:06:11arkhiveSchbirid: the server you mentioned earlier with 100Mb connection. I'm interested in getting one...if the price is right.
Jul_13_2012_04:59:02Coderjoearkhive: btw, Schbirid had been gone for 2.30 hours prior to you attempting to ask the question
Jul_13_2012_05:00:03Coderjoeer, 3.30 hours
Jul_13_2012_07:10:00arkhiveoh
Jul_13_2012_07:10:48arkhivedo you know about using servers for AT andthe costs
Jul_13_2012_07:11:29arkhiveand i'm going to bed. it's 1:11am here
Jul_13_2012_07:11:50arkhivebut let me know.. i'm leaving irc on. night
Jul_13_2012_07:24:48ersiarkhive: afaik schbirid has a free server from a OVH campaign
Jul_13_2012_07:34:51GLaDOSMultiple free servers, I think.
Jul_13_2012_13:57:15Schbiridi think ovh has servers available again right now ovh.com/bhs
Jul_13_2012_14:02:34Schbiridoops, i had one laying around for 3 weeks unused
Jul_13_2012_14:03:40Coderjoecheck the sofa cushions!
Jul_13_2012_14:05:27Schbiridtime to slap tor on it just to make it useful
Jul_13_2012_14:14:58CoderjoeSchbirid: by the way, what format are those archives you wanted to serve from a compressed/deduped setup?
Jul_13_2012_14:15:26Schbiridhtml files in many directories
Jul_13_2012_14:15:28Schbiridoh
Jul_13_2012_14:15:32Schbiridi would use anything
Jul_13_2012_14:15:37Schbiridtar.gz seems alright
Jul_13_2012_14:15:40Coderjoewhat are they currently?
Jul_13_2012_14:15:44Schbiriddunno if i put them into 7z yet
Jul_13_2012_14:15:54Schbiridi have them as many seperated 7z files though
Jul_13_2012_14:15:59Coderjoe7z would be terrible for CPU usage when serving them out
Jul_13_2012_14:16:03Schbiridyeah
Jul_13_2012_14:16:47Coderjoeyou have to decide on the tradeoff between compression ratio and CPU usage to access a file from within
Jul_13_2012_14:17:28CoderjoeI suppose 7z wouldn't be too bad if it weren't solid, but then you aren't much better off than a zip file for compression ratio
Jul_13_2012_14:18:22Schbiridthe targz is 15G which is alright with me
Jul_13_2012_14:18:35Schbiridhavent tried zip iirc
Jul_13_2012_14:18:47Coderjoecare to see what tar.bz2 does?
Jul_13_2012_14:19:21Schbiridwell, serving the tar.gz with avfs and google bot accessing pages every few minutes already used all cpu (load of ~5)
Jul_13_2012_14:19:32Schbiridor would bz2 be better to uncompress?
Jul_13_2012_14:19:53Coderjoeloadavg is not indicitive of cpu usage
Jul_13_2012_14:20:48Coderjoebz2 is split into discrete blocks, which would make random access easier (if you had the code in place to do random access)
Jul_13_2012_14:21:59Coderjoewhereas, while gz can have multiple blocks, it isn't required, and backreferences can be made across a block boundary
Jul_13_2012_14:24:17Coderjoe(so you would have to index the location of the start of each block in the compressed file, the location in the uncompressed stream, and the state of the window, or as much as is needed based on scanning the data)
Jul_13_2012_14:24:47Coderjoe(bz2 could do random access with a minimum of compressed block start offset and uncompressed stream offset)
Jul_13_2012_14:30:31Schbiridnice, i will try it
Jul_13_2012_14:32:37Coderjoeunfortunately, I am not aware of any existing software that really allows such random access
Jul_13_2012_15:11:22SmileyGhmmm winr4r :O
Jul_13_2012_15:15:46Schbiridoh
Jul_13_2012_15:21:02Schbiridoh nice, my robots.txt files 7z finished. 300MB :)
Jul_13_2012_15:36:13Schbiridavfs says it does
Jul_13_2012_15:36:14Schbirido Indexing of gzip and bzip2 files. This achieves fast random
Jul_13_2012_15:36:14Schbiridaccess to the uncompressed files without caching to whole file.
Jul_13_2012_15:38:09godaneuploading episode 30 of GBTV
Jul_13_2012_15:38:12godane:-D
Jul_13_2012_15:38:39godanei almost have you guys up to november 2011 with this
Jul_13_2012_15:39:47godanejust know the earlyer copys was re-encoded to be at 800mb
Jul_13_2012_15:54:38winr4rSmileyG: hmm?
Jul_13_2012_15:56:46winr4roh, the £414 battery pack? that is hilarious
Jul_13_2012_15:57:39SmileyGyah
Jul_13_2012_15:57:42SmileyGis that serious price?
Jul_13_2012_15:59:58winr4rSmileyG: well, the same seller has lots of nikon batteries, listed at not-totally-insane prices
Jul_13_2012_16:00:13winr4rbut then they have D1 batteries listed at *fucking insane* prices
Jul_13_2012_16:00:49winr4ri just ordered one from another seller, for £14
Jul_13_2012_16:01:32SmileyGD:
Jul_13_2012_16:01:45SmileyGWeird.
Jul_13_2012_16:02:47winr4rmaybe they're cashing in on the ebaying-so-drunk-they-read-£414-as-£14 market
Jul_13_2012_16:09:03SmileyGAAAAArugh
Jul_13_2012_16:09:10* SmileyGjust crashed vbox twice in a row freezing his system
Jul_13_2012_16:09:21winr4rp.s. don't drink and ebay, there's people willing to take advantage of you
Jul_13_2012_16:09:24winr4rSmileyG: :<
Jul_13_2012_16:09:38winr4rwhat happens if you crash it twice in a row, rather than once?
Jul_13_2012_16:10:51SmileyGworld ends.;
Jul_13_2012_16:12:05winr4roh, you meant you crashed your system twice
Jul_13_2012_16:12:09winr4rnever mind
Jul_13_2012_16:39:01Coderjoemore on the passwords that were leaked the other day: http://boingboing.net/2012/07/12/crummy-passwords-from-yahoo-us.html
Jul_13_2012_16:40:59Schbiriddirect link http://pastebin.com/2D6bHGTa
Jul_13_2012_16:41:40Schbiridloweralpha: 146486 (33.08%)
Jul_13_2012_16:41:42Schbiriddamn
Jul_13_2012_16:42:52Schbiridncie tool http://www.digininja.org/projects/pipal.php
Jul_13_2012_16:59:52Schbirid~200 of the alexa top 10000 domains disallow / for ia_archiver
Jul_13_2012_17:04:30Schbiridhow do i make an easy bash for loop over a-z?
Jul_13_2012_17:06:42Schbirid{a..z}
Jul_13_2012_17:06:42Schbiridbash rules so much
Jul_13_2012_17:07:01winr4ryes it does
Jul_13_2012_17:07:27yipdwexcept where its syntax is shit
Jul_13_2012_17:07:46winr4ri thought it was [a-z] though
Jul_13_2012_17:09:43yipdw[ evaluates tests, so it can't be [
Jul_13_2012_17:09:51yipdw(case in point, heh)
Jul_13_2012_17:10:11yipdwthat said, if you write e.g. for i in [a-z]; do echo $i; done
Jul_13_2012_17:10:21yipdwdepending on your version and environment you WILL get something that starts out like a loop
Jul_13_2012_17:10:28yipdwbut it will not behave the way you expect:
Jul_13_2012_17:10:46yipdwwell, just try it if you're on bash 3.2.48
Jul_13_2012_17:10:53yipdwI don't know what the fuck it does on 3.2.minorrevisionup
Jul_13_2012_17:10:55yipdwmuch less 4
Jul_13_2012_17:11:26winr4r[ with a space after it evaluates tests
Jul_13_2012_17:11:46yipdwthen I don't know what [a-z] is actually doing
Jul_13_2012_17:11:56Coderjoe[ is an alias/link to the "test" command
Jul_13_2012_17:12:19winr4rgo to your home directory, do "ls [a-c]*"
Jul_13_2012_17:12:29yipdwoh, it's a range
Jul_13_2012_17:12:31winr4rthen go tell me how wrong i am about it
Jul_13_2012_17:12:33yipdwin pathname expansion
Jul_13_2012_17:12:38yipdwbut not in for loops
Jul_13_2012_17:12:38yipdwok
Jul_13_2012_17:12:46yipdwso it's a range in a different context
Jul_13_2012_17:12:47yipdwQED :P
Jul_13_2012_17:12:54yipdwbash sucks so much
Jul_13_2012_17:13:12winr4ryipdw: yes it does
Jul_13_2012_17:13:23winr4ryipdw: it made us argue about stupid shit
Jul_13_2012_17:13:53winr4rit's like that asshole who goes to a party and starts fights between people who would otherwise be friends, "hey did you hear what he just said?"
Jul_13_2012_17:14:11winr4ri mean that guy SUCKS
Jul_13_2012_17:14:35Schbiridbash is fantastic for quick hacky
Jul_13_2012_17:15:46yipdwI guess
Jul_13_2012_17:39:10underscorbash is fantastic as a command interpreter
Jul_13_2012_17:46:51yipdwI'd say it's about as good as Marcus Brutus
Jul_13_2012_17:46:58yipdwit's pretty good until it stabs you in the back
Jul_13_2012_17:47:13yipdwand it has a bunch of hidden state
Jul_13_2012_17:47:53yipdw(if someone can clarify /etc/bashrc vs. ~/.bashrc vs. /etc/profile.d vs. ~/.bash_profile for me that'd be pretty cool -- I keep forgetting what does which and when)
Jul_13_2012_17:48:28yipdwalso, I don't hate bash
Jul_13_2012_17:48:59Schbiridwell, the ~ ones are user specific
Jul_13_2012_17:49:29yipdwI keep forgetting which apply to interactive vs. non-interactive shells
Jul_13_2012_17:49:36yipdwand it doesn't seem to be consistent across systems anyway
Jul_13_2012_17:49:48yipdwUbuntu uses bash_profile for interactive shells, I think
Jul_13_2012_17:49:55yipdwI'm not sure if CentOS does
Jul_13_2012_17:50:05yipdwmaybe it does
Jul_13_2012_17:50:24yipdwI know one recommendation is that you just source one from the other
Jul_13_2012_17:50:42yipdwwhich seems to be an admittance of "hey guys we may have done fucked this up a bit"
Jul_13_2012_17:51:39* yipdwshrugs
Jul_13_2012_17:51:51yipdwI've been fixing bash-related crap for a couple weeks, so I'm probably just venting
Jul_13_2012_17:51:52Schbiridi did that minutes ago :P
Jul_13_2012_18:49:23winr4ryipdw: if you find yourself doing that, it's probably best to write in python or perl
Jul_13_2012_19:00:36winr4rby "python or perl" i mean "something that isn't bash"
Jul_13_2012_19:05:23Schbiridi wish the software world would move to python3 alltogether already
Jul_13_2012_19:06:56mistymyipdw: http://www.joshstaiger.org/archives/2005/07/bash_profile_vs.html - best short explanation I've seen
Jul_13_2012_19:07:40winr4rSchbirid: meh
Jul_13_2012_19:07:46winr4rnot really all that much reason to do so
Jul_13_2012_19:09:59Schbiridi love this story so much http://www.untoldentertainment.com/blog/2011/03/05/holding-the-bag-how-i-gamed-gdcs-top-social-game-developers/
Jul_13_2012_19:42:44godanehey everyone
Jul_13_2012_19:42:55godaneuploading more GBTV
Jul_13_2012_19:43:11godanethis is guy is BIG data
Jul_13_2012_19:43:49godanewith 4 to 5gb of week of shows it takes alot of time to upload
Jul_13_2012_19:48:07winr4rawesome
Jul_13_2012_23:08:57Coderjoeand the vuln is supposedly fixed: http://www.theregister.co.uk/2012/07/13/yahoo_fixes_password_hole/