email: bigwebb@gmail.com for changes to this service

#archivebox 2011-08-08 :: 2011-08-07 :: 2011-08-06 :: 2011-08-05 :: 2011-08-04 :: 2011-08-03 :: 2011-08-02 :: 2011-08-01 :: 2011-07-31 :: 2011-07-30 ::
#archiveteam 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 :: 2013-05-15 ::
#archiveteam-bs 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 :: 2013-05-15 ::
#archiveteam-twitter 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 :: 2013-05-15 :: 2013-05-14 ::
#flickrfckr 2013-05-04 :: 2013-04-21 :: 2013-04-10 :: 2013-03-27 :: 2013-02-23 :: 2013-02-11 :: 2013-02-09 :: 2013-02-02 :: 2013-01-25 :: 2013-01-24 ::
#urlteam 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 :: 2013-05-15 :: 2013-05-14 ::
#warrior 2013-05-24 :: 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 :: 2013-05-15 ::
#wikiteam 2013-05-23 :: 2013-05-22 :: 2013-05-21 :: 2013-05-20 :: 2013-05-19 :: 2013-05-18 :: 2013-05-17 :: 2013-05-16 :: 2013-05-15 :: 2013-05-14 ::
Jun_28_2012_00:52:33omf_fuck yeah. I got something to contribute
Jun_28_2012_00:52:45omf_I got 50 disks for the cdbbsarchive
Jun_28_2012_00:52:59omf_I collect video games and I got shareware disks
Jun_28_2012_00:56:29SketchCowWonderful.
Jun_28_2012_00:56:36SketchCowWant to scan them and I can give you a FTP?
Jun_28_2012_00:56:59godaneSketchCow: i added to cdroms to archive.org
Jun_28_2012_00:57:12godanehttp://archive.org/details/cdrom-3d-world-119
Jun_28_2012_00:57:16godanehttp://archive.org/details/cdrom-3d-world-150
Jun_28_2012_00:57:34godanecan you put them in shareware section?
Jun_28_2012_01:03:32omf_I am going to dig them out. Is there a list to check against besides the archive.org page you posted earlier?
Jun_28_2012_01:04:29balrog-SketchCow: my brother has been using a Panasonic GH1 SLR for video, does a pretty darn good job
Jun_28_2012_01:14:06omf_SketchCow, I just watched the open source bridge 2012 keynote. What exactly am I supposed to get out of it?
Jun_28_2012_01:14:35omf_wait a sec
Jun_28_2012_01:15:00omf_ugh, didn't notice it started 6m in
Jun_28_2012_01:15:07omf_lets see who is before
Jun_28_2012_01:21:55SketchCowI was just showing that they do a good keynote recording.
Jun_28_2012_01:22:44balrog-they do — any midrange HD camcorder will give decent results
Jun_28_2012_01:23:40SketchCowBoth cdroms ingested.
Jun_28_2012_01:23:53omf_yes it is a good recording
Jun_28_2012_01:24:20omf_a bad one is the recent Linus Torvalds one. In and out of focus constantly and whipping the camera around to find the "action"
Jun_28_2012_01:24:32omf_shit kinda sucked. Content was great
Jun_28_2012_01:26:40balrog-a lot has to do with technique
Jun_28_2012_01:27:01omf_balrog-, do you mean lack of technique? ;)
Jun_28_2012_01:27:42balrog-more or less :P
Jun_28_2012_01:28:18omf_It is disappointing. I have helped organize conferences and there is never the money to get even semi-pros to do shooting
Jun_28_2012_01:32:03arkhivemy 'touch STOP' isn't working
Jun_28_2012_01:32:21balrog-arkhive: it takes a little time, the current job needs to finish
Jun_28_2012_01:32:30arkhiveya it did
Jun_28_2012_01:32:54balrog-well it worked for me...
Jun_28_2012_01:33:30arkhiveiu tried then it fetched another user name about 30 minutes ago
Jun_28_2012_01:34:21arkhiveCan't I try putting a blank file called STOP in my directory? I think I did that with Google Video
Jun_28_2012_01:34:52balrog-touch should create such a blank file
Jun_28_2012_01:35:46DoubleJThe STOP needs to have a newer modified time than when the instance started running.
Jun_28_2012_01:36:16DoubleJSo if you have a STOP file from yesterday, it will never affect a download you started today.
Jun_28_2012_01:37:04arkhivea stop file was never created :/
Jun_28_2012_01:37:36DoubleJHm. Is it in the root of the project (e.g. mobileme-grab/STOP)?
Jun_28_2012_01:41:25arkhivenope
Jun_28_2012_01:41:34arkhiveI added one though.
Jun_28_2012_01:42:08arkhivestill stuck at the - Discovering urls (XML)
Jun_28_2012_01:42:20arkhivefor the next user
Jun_28_2012_01:42:47DoubleJThe next user after you created the STOP file? Or the user that was already running?
Jun_28_2012_01:43:29arkhivethe user before i created the stop file is still at 'discovering urls(xml)
Jun_28_2012_01:43:44arkhiveeven after i created the STOP file
Jun_28_2012_01:43:50DoubleJThat's fine. That user will go until it's complete.
Jun_28_2012_01:44:04DoubleJThe downloader only checks when a user is done.
Jun_28_2012_01:44:52DoubleJThe "discovering" step can take a while; it has to parse a (sometimes large) XML file, grab the URLs, sort them and remove duplicates. I had one user that took 12 hours on that step.
Jun_28_2012_01:45:34arkhivealright.
Jun_28_2012_01:45:54arkhiveYa, I'm at ~14 GB now
Jun_28_2012_01:46:46DoubleJYup. As long as you're not low on drive space just let it run. It'll finish eventually (or die trying).
Jun_28_2012_01:48:26arkhive700 GB left
Jun_28_2012_01:48:34DoubleJYou'll be fine.
Jun_28_2012_01:49:29DoubleJAll right, gonna go zonk out. Later.
Jun_28_2012_01:56:14balrog-I have 3 machines running, 2 of them running seesaw
Jun_28_2012_02:18:07underscorhttp://forum.cultofmac.com/discussion/comment/144780/#Comment_144780
Jun_28_2012_02:18:13underscorLOVE THIS GUY
Jun_28_2012_02:20:28omf_no one said apple users had brains
Jun_28_2012_02:22:35balrog-underscor: You have people like that everywhere :/
Jun_28_2012_02:22:48underscoryeah :(
Jun_28_2012_02:24:40omf_has anyone ever challenged the legality of the project? I mean with fools like that guy who is suing the oatmeal
Jun_28_2012_02:27:00Coderjoewe have advertising?
Jun_28_2012_02:28:08aggroWe have a Grandstand?
Jun_28_2012_02:28:20Coderjoeshit, why didn't anyone tell me? Where do I get my cut?
Jun_28_2012_02:29:18aggroAs far as I know, there isn't much case law to go on concerning online archiving and online libraries.
Jun_28_2012_02:30:15omf_the point that always sticks we me about this: If you view something online, then you have already downloaded it how is keeping a copy a bad thing?
Jun_28_2012_02:30:25Coderjoe*sigh* here we go again. :-\ If you wish to continue the discussion of legality, please move it to -bs
Jun_28_2012_02:30:58omf_I just wondered if anyone tried to start shit. It is legal until the courts say it isn't.
Jun_28_2012_02:31:17omf_damn the shareware rip I just did failed.
Jun_28_2012_02:31:30omf_This drive is a constant problem
Jun_28_2012_02:32:39godaneSketchCow: can you setup the ftp for me?
Jun_28_2012_02:32:58underscorI don't even get what we're advertising?
Jun_28_2012_02:33:03underscorIt's not like we sell things
Jun_28_2012_02:33:14underscorGrandstanding for what?
Jun_28_2012_02:33:26underscorWe do what we do regardless of who knows or whatever >:|
Jun_28_2012_03:01:55shaqfuArchive Team is a sting operation; archive.org actually pipes to /dev/null
Jun_28_2012_03:42:49underscorlol
Jun_28_2012_03:55:15godanefound newer byte magazine pdfs: http://thepiratebay.se/torrent/7380688/BYTE_magazine_full-res_scans_PDF_JC1.0_20120622
Jun_28_2012_03:56:33godaneyou can all just download them here too: http://malus.exotica.org.uk/~buzz/byte/pdf/
Jun_28_2012_05:34:48omf_thanks for those bytes
Jun_28_2012_07:07:15Lord_Nighgrr connection is going f***ing haywire
Jun_28_2012_10:36:32SketchCowhttps://www.youtube.com/watch?v=tJqZGRIwtxk&feature=plcp
Jun_28_2012_10:54:37omf_I am watching your talk now
Jun_28_2012_11:00:36omf_wow that is a large amount of shareware disks. Are they all available online?
Jun_28_2012_11:02:39Coderjoea lot of them are at cd.textfiles.com and probably on archive.org by now
Jun_28_2012_11:03:12omf_that is dope as hell. That is why I want to add stuff too. I collect video games and things surrounding it
Jun_28_2012_11:24:56ersiCoderjoe: yeah, AFAIK all of SketchCow's shareware disks from cd.textfiles.com have been ingested into IA, think there's a couple o blogposts about it~
Jun_28_2012_11:29:26CoderjoeRTTY art? wow
Jun_28_2012_11:33:16Coderjoehaha
Jun_28_2012_11:33:36Coderjoenice use of the Tsukasa cellphone gif
Jun_28_2012_13:25:28fLooyay
Jun_28_2012_13:25:43fLooi just attached another 15 tb to my home esxi
Jun_28_2012_13:25:44fLoo:)
Jun_28_2012_13:26:39SmileyG:)
Jun_28_2012_13:27:03fLooi love esata-external-raid-bays
Jun_28_2012_13:27:43fLoono need to care about the cableing inside the server anymore
Jun_28_2012_13:27:50fLoojust attach and become happy
Jun_28_2012_13:27:51fLoo=)
Jun_28_2012_13:30:02SmileyGproper servers are fun? :)
Jun_28_2012_13:30:24SmileyGby that I mean proper backplanes. btw this should be -> #archiveteam-bs
Jun_28_2012_13:30:40fLoowhat does bs mean ?
Jun_28_2012_13:30:49fLooim new here, sorry
Jun_28_2012_13:31:03SmileyGerm, something that comes outta a cows bottom ;)
Jun_28_2012_13:31:14SmileyGThis channel is strictly for archive-team discussion onjly
Jun_28_2012_13:31:15fLooah bullshit
Jun_28_2012_13:31:15fLoo:D
Jun_28_2012_13:31:20SmileyGeverything offtopic goes in-> -bs :)
Jun_28_2012_13:31:24fLoothanks :-)
Jun_28_2012_16:12:58swebb80M unwound url-shortener urls from the twitter spritzer stream since Oct 2011: https://www.dropbox.com/s/xjle0ksvzeik8mf/urls.txt.bz2 [1.75GB]
Jun_28_2012_16:24:17SketchCowGrab it!!!!
Jun_28_2012_16:24:52swebbIt's actually mine. I'll leave it there for a while.
Jun_28_2012_16:26:32BlueMaxNice grab swebb
Jun_28_2012_16:27:59BlueMaxSketchCow, I'm watching the OSB keynote and just got to the ArchiveTeam Warrior part, was this based off the old ArchiveBox project?
Jun_28_2012_16:28:13Schbiridlink?
Jun_28_2012_16:28:26swebbI've been pulling the spritzer stream since Oct. I'm now unwinding all of the urls as they come in.
Jun_28_2012_16:28:43BlueMaxhttps://www.youtube.com/watch?v=tJqZGRIwtxk&feature=plcp < 26:30 ish
Jun_28_2012_16:29:24Schbiridthx
Jun_28_2012_16:34:07BlueMaxI'm downloading the ArchiveTeam Warrior now
Jun_28_2012_16:34:51BlueMaxWasn't it me that came up with that idea?
Jun_28_2012_16:34:55BlueMaxIt was ages ago, sure
Jun_28_2012_16:35:23BlueMaxmight have been someone else
Jun_28_2012_16:37:13BlueMaxLike we had half a team working on it but it kinda fell by the wayside
Jun_28_2012_16:37:59BlueMaxAnd here's the Javascript MESS Project :D
Jun_28_2012_16:38:35SketchCowYes, this is 2.0
Jun_28_2012_16:39:16BlueMaxWas that my idea or not? I honestly don't remember, I remember doing a Piratepad/Etherpad on it writing down ideas though
Jun_28_2012_16:39:21ersiNo, we were circle jerking and talking about what GUI we should ship with a VM *if* we'd actually make a VM
Jun_28_2012_16:39:45ersithen alard whipped together a VM with some scripts and stuff, now - that's AT Warrior. Doing in action
Jun_28_2012_16:40:13ersiDoes it matter who's idea it was? :)
Jun_28_2012_16:40:58BlueMaxlol, not at all, I swear I thought of something like that and told you all about it :P
Jun_28_2012_16:41:08godaneSketchCow: added http://archive.org/details/cdrom-3d-world-142
Jun_28_2012_16:41:48BlueMaxhaha, Lucky Star reference at the end
Jun_28_2012_16:41:49godanei really need access to adding to software section
Jun_28_2012_16:46:30fLooanyone got a good idea
Jun_28_2012_16:46:36fLoohowto use my new 15 tb ?
Jun_28_2012_16:46:36fLoo:D
Jun_28_2012_16:47:10BlueMaxbe right back
Jun_28_2012_16:47:25Famicomanwget -r google.com
Jun_28_2012_16:47:31fLookidding me ?
Jun_28_2012_16:47:36fLooalready done!!1
Jun_28_2012_16:47:48Famicomanees a joke
Jun_28_2012_16:47:51fLooorly ;)
Jun_28_2012_16:49:28underscorBlueMax: Yeah, I think you said the first thing
Jun_28_2012_16:49:33underscorlike a year ago
Jun_28_2012_16:49:34underscorlol
Jun_28_2012_16:50:07BlueMaximwas it really only a year? Feels so much longer :P
Jun_28_2012_16:50:22BlueMaximoi, BlueMax, get outta here
Jun_28_2012_16:50:50underscorMy year-versary with archiveteam was February
Jun_28_2012_16:51:00SketchCowHurrah
Jun_28_2012_16:51:10underscorso I couldn't have been too much longer than that
Jun_28_2012_16:51:16underscors/I/it/
Jun_28_2012_16:51:26BlueMaximI remember the day I joined was the day that Slashdot put up an article on the Geocities torrent
Jun_28_2012_16:51:40DFJustin"anniversary" already means year-versary :P
Jun_28_2012_16:51:44swebbunderscor: Yea!
Jun_28_2012_16:51:52underscorDFJustin: :P fiiine
Jun_28_2012_16:51:59underscor:o SketchCow enters
Jun_28_2012_16:52:03underscorEveryone look busy
Jun_28_2012_16:52:06BlueMaximI joined in October 2010 so I've been here longer than you underscor :P
Jun_28_2012_16:52:16BlueMaximI just wish I was near as useful
Jun_28_2012_16:52:19swebbI started in 2008/2009 range and my first major project was GeoCities.
Jun_28_2012_16:52:21underscorI've been here since yahoo video
Jun_28_2012_16:52:32underscorwhich was before BlueMaxim joined, isn't it?
Jun_28_2012_16:52:35swebbbut I'm not here every day.
Jun_28_2012_16:52:59BlueMaximI swear I came in here when Slashdot put an article up on the Geocities torrent, and I googled it and it was in October 2010
Jun_28_2012_16:53:02godanebeen here since google videos back
Jun_28_2012_16:53:19FamicomanI think I registered on the wiki in January of 2009
Jun_28_2012_16:53:29Famicomanthere were like 8 people in here
Jun_28_2012_16:55:15SketchCowWe need more people!!
Jun_28_2012_16:55:25Schbiridpublic service announcement: IGN/Gamespy are a bunch of idiotic fuckwits
Jun_28_2012_16:55:36SketchCowMORE MORE
Jun_28_2012_16:55:56godanemy big project right now is uploading all the 3d world isos i have found
Jun_28_2012_16:55:57BlueMaximSketchCow if I had the ability I'd go on public television with a cry for members :)
Jun_28_2012_16:56:04underscorBlueMaxim: I swear you came after me :P
Jun_28_2012_16:56:18Famicomanthat's a go idea
Jun_28_2012_16:56:19BlueMaximunderscor I would rephrase that sentence
Jun_28_2012_16:56:21BlueMaximright goddamn now
Jun_28_2012_16:56:26underscorhahahahahahahha
Jun_28_2012_16:56:26underscor<3
Jun_28_2012_16:56:32Famicomanlets buy adspace on late night television
Jun_28_2012_16:56:39underscorWow
Jun_28_2012_16:56:47Famicoman:P
Jun_28_2012_16:56:52underscorFileplanet made all files not-downloadable now
Jun_28_2012_16:56:59Schbiridnot that
Jun_28_2012_16:57:04Schbiridbut they ruined our way
Jun_28_2012_16:57:26underscorer, yeah.
Jun_28_2012_16:57:37underscorthey made it much more difficult
Jun_28_2012_16:58:26BlueMaxWhatever happened to...Andrea, wasn't it?
Jun_28_2012_16:58:38BlueMaxI think he/she was working on the QDB archival project
Jun_28_2012_17:01:06BlueMaxAlso I need to get the ArchiveMeme thing working again, it was fun when Jason had a beard
Jun_28_2012_17:01:41Schbiridlesson learned: never contact a host you are trying to save
Jun_28_2012_17:02:04frame_atSketchCow: do you need any direct donations for the last two days of mobile.me archiving?
Jun_28_2012_17:02:17frame_atother than helping to grab the data
Jun_28_2012_17:03:58balrog-Schbirid: so there's no way to archive fileplanet now? :(
Jun_28_2012_17:05:01Schbiridbalrog-: we got the easy part done 99%. but the oldest/rarest files were not grabbed that way (i was simply incrementing an ID, not all files were accessible through that)
Jun_28_2012_17:05:10balrog-ugh.
Jun_28_2012_17:05:12Schbiridright now it looks like they completely stopped serving the old files
Jun_28_2012_17:05:20balrog-Schbirid: can you link me one of the old files?
Jun_28_2012_17:05:26balrog-or is there a list somewhere?
Jun_28_2012_17:05:34Schbiridhttp://archiveteam.org/index.php?title=Fileplanet/non-id-urls is our (very incomplete) dump
Jun_28_2012_17:05:50Schbiridi'm gone in a moment, bb tomorrow
Jun_28_2012_17:05:53balrog-ok.
Jun_28_2012_17:05:59balrog-how soon do we expect this to go away?
Jun_28_2012_17:06:40Schbiridwas not expected soon at all (a year or so). but those files ARE "gone" now
Jun_28_2012_17:06:46balrog-yeah, 404 :(
Jun_28_2012_17:06:59Schbiridmaybe, if i am super lucky, my contact still has a way to get them. we'll see
Jun_28_2012_18:02:44omf_Is there anyone around working on the fileplanet thing? I think I found a way to *fix* all the urls. I posted it in #fireplanet 30 minutes ago and with no response I thought I would mention it here
Jun_28_2012_18:12:04SketchCowI just moved all of godane's CD-ROM images over.
Jun_28_2012_18:12:17SketchCowGodane, just keep uploading them, I can do bulk transfers.
Jun_28_2012_18:16:20patrickgSketchCow: I
Jun_28_2012_18:16:43patrickgSketchCow: I'm done with the OSS repo for now - disk crashed, but I think I uploaded all repos that are dead upstream
Jun_28_2012_18:24:15godaneSketchCow: Why is this listed as text: http://archive.org/details/cdrom-3d-world-141
Jun_28_2012_18:24:51godanei know its in shareware cd archive but its a iso image not text file
Jun_28_2012_18:24:59SketchCowpatrickg: Thank you.
Jun_28_2012_18:25:24SketchCowgodane: It's not
Jun_28_2012_18:25:27SketchCowReload.
Jun_28_2012_18:25:38SketchCowpatrickg: So should I start trying to upload it to archive.org?
Jun_28_2012_18:27:17SketchCowI see a number of empty directories.
Jun_28_2012_18:28:02SketchCowOh, I see....
Jun_28_2012_18:28:30godanethere is empty folders in 3d world isos alot
Jun_28_2012_18:29:06godanei think its mostly cause of the way it uses 3dw.exe
Jun_28_2012_18:29:06patrickgSketchCow: ignore everything but packed-mirror
Jun_28_2012_18:29:25SketchCowReally?
Jun_28_2012_18:29:29SketchCowLEt's take this to a pm.
Jun_28_2012_18:29:33SketchCowLet's quickly work through it.
Jun_28_2012_18:56:56underscoralard: do you have a /56 aware google scraping script?
Jun_28_2012_18:58:06alardunderscor: https://gist.github.com/2788197d2db2779cb7b0
Jun_28_2012_18:58:28underscorer, yeah, 58
Jun_28_2012_18:58:30underscor48*
Jun_28_2012_18:58:31underscorthank
Jun_28_2012_18:58:34underscorthanks!
Jun_28_2012_19:31:17fLoobtw
Jun_28_2012_19:31:26fLooi used google ipv6-"exploit" for so long now
Jun_28_2012_19:31:34fLooneed it for google maps requests
Jun_28_2012_19:31:41fLooso i can do like unlimited per day without paying for it
Jun_28_2012_19:33:49omf_fLoo, was openstreetmap not working for you?
Jun_28_2012_19:34:09fLoowell
Jun_28_2012_19:34:23fLooi need several things which doesnt make osm an option
Jun_28_2012_19:34:36omf_data
Jun_28_2012_19:34:38omf_I got you
Jun_28_2012_19:34:49fLoowell basically its the geocoding
Jun_28_2012_19:36:39godanelooks like there are dvd disk of 3d world magazines
Jun_28_2012_19:37:31godanewas not sure if the dvd was special magazines or not
Jun_28_2012_19:45:00godaneSketchCow: Add to shareware cd section: http://archive.org/details/cdrom-3d-world-139 and http://archive.org/details/cdrom-3d-world-140
Jun_28_2012_19:45:05SketchCowShhh.
Jun_28_2012_19:45:08SketchCowYou need not do this.
Jun_28_2012_19:45:13SketchCowJust upload, I'll do a bulk.
Jun_28_2012_19:45:17godanesorry
Jun_28_2012_19:46:34* Nemo_biseager to see the next bunch of Italian shareware discs
Jun_28_2012_19:48:44SketchCowIt'll be a while
Jun_28_2012_19:48:51SketchCowI'm only home for hours at a time this month and the next.
Jun_28_2012_19:50:51Nemo_bisI see
Jun_28_2012_20:44:35arkhiveerr. I keep timing out while archiving mobileme...
Jun_28_2012_20:44:43arkhive- Running wget --mirror (at least 4298 files)...NOTE: you should run 'diskperf -y' to enable the disk statistics
Jun_28_2012_20:45:04arkhivesince 1:03 am Mountain time.
Jun_28_2012_21:12:21godanei must have uploaded 4.4gb of just 3d world isos so far
Jun_28_2012_21:14:17godane109, 110, 116, and 125 are next iso images to do
Jun_28_2012_21:14:46godanei want to save 151 thur 157 for last
Jun_28_2012_21:15:13godaneeven though i got them completed
Jun_28_2012_21:15:52godanethose came out this year so i don't want ia to dark archive them