2007-05-01

Amazon S3 for media backup

I've been concerned about backing up my videos and pictures for as long as I've been taking them, but until a week ago I never bothered to think much about a commercial service. I would periodically burn DVDs, multiple DVDs of the same data- worried that the DVDs would degrade after a few years. I'd also make hard drive backups and then store the hard drives and some of the dvds offsite.

DVDs are poor for backup as soon as a platter is full of them- it takes a lot of time to find specific files later on. Hard drives are better, but expensive. Recently I had two hard drives fail in a row- they still sort of work, I can recover data off them, but they don't work as boot drives and were at times making clunking noises.

Another feature I've been in need of is a way of transferring videos to people, or hosting high quality videos. Youtube/vimeo/google-video/etc. is low quality and I don't necessarily want to give the videos to the entire world.

I'd heard about Amazon's S3 service a while back, but it doesn't have a friendly user interface by default- and I wasn't sure about paying for third party software like jungledrive, and I didn't want to pay another service like that something-else-drive. I've bought things from Amazon before, they have my credit card information already, and I like their pricing scheme. Other services want you to pay an excess- $10 a month for 100 GB, great deal if you fill up that 100 GB immediately, but poor if you only use 10 GB at first.

Then I found S3 firefox plugin. I can't vouch for the security of this plugin, but it seems to work and the media I'm backing up isn't that security critical. The plugin allows simple uploading and downloading and access control setting of files.

Over a cable modem, it took me about 3-days of uploading to get 10 GB of pictures onto S3. This is slow, but once they're uploaded the rate at which I take new pictures is much lower than backing up several years of pictures all at once.

At they're current pricing this 10 GB will cost $1 .50 a month, and I anticipate they'll lower the price per GB as storage prices fall. In the next week I'll probably have 20 GB up, so $3 a month or $36 a year. If I was just storing pictures this would start to compare poorly with flickr or other photo sites, which charge a flat yearly rate for 'unlimited' storage- but I like the raw interface for uploading and the truly unlimited feeling of S3, and I also don't plan on having too many GB of just pictures.

Video is the real hard-drive killer, and unfortunately S3 isn't going to be a good solution for raw off the camera DV or HDV or other kinds of video. The files are too big: S3 file limit size is 5 GB also, though I can chop up some of the bigger video files, it takes too long to transfer, and it will cost too much. I could easily have a terabyte of video pretty soon. I suppose it's not all worth backing up, maybe if I keep my S3 total under 50 -100 GB I won't mind the cost too much.

For now, I'm just backing up editing compressed video- wmv files under 100 MB. I might progress to backing up less heavily compressed files later. It's easy to share the files with others, set them to global read-only and email people the link- or if the third party has an Amazon account and gets Firefox + the S3 plugin going you can specifically allow them and only them to have read or even write access.

2007-04-21

911 Media Open Lab - April 15




911 Media Arts Center Open Lab - 2007.04.15 on Vimeo

I bought a new laptop somewhat recently, and am currently dual-booting between Vista & Ubuntu. Most of my custom software was only set up to run in Ubuntu, but I forgot to figure out getting the S-Video output to work when I brought it to Open Lab- despite all the other ease-of-use advances of Ubuntu something as simple as configuring an external output is still a pain. So instead I went back into Vista and just messed around with Wings3D, while others manipulated that source video with some hardware video mixers.

The slower bits are edited out, and overall I like the most of the scenes in there- even if they don't match up to the (also live generated) music, I think there's a few underlying ideas that could be developed into more interesting clips:
-Flying over alien landscapes, manipulating them, and a kind of 80s CG flat shading look
-Simple shapes that generate fractals

Wings isn't really meant for live performance. With a little more work I could set up a lot more keyboard shortcuts so the context menus don't show up as much. A more intensive effort would be to make models in Wings, export them to objs or something and a have a custom app running on the external monitor that can be triggered to load the model.

2007-04-09

Bones Animation - Re-Acting


Bones - Re-Acting from binarymillenium on Vimeo.

I think I could have done a better job with this video, edited it a little more heavy, but I don't like to get to bogged down with it. I sort of think as these as visual notes to myself, I can refer back to them and recreate the effect I captured in a bigger and more meaningful work.

The main thing making editing more difficult was that I was using image sequences in Premiere- my computer isn't fastest enough to actual play back unrendered image sequences (and I was too lazy to render it), so it was hard to get the edits and feel right.

The source imagery is from a code.google project called 'bones' http://code.google.com/p/binarymillenium/wiki/Bones. It's a very simplistic bones animation implementation, using osg::nodes and with randomly generated hierarchy and animation. Every vertex in the object loaded for a bone has a weight that mixes (using quaternion slerp) the positions of the parent osg::node and the child. The weights are automatically generated based on the distance from the vertex from the root of the object where it joins with the parent.

2007-03-18

VJ/Visualization Blogs

I was randomly searching for something the other day and came across a lot of interesting blogs:

Create Digital Motion
This one has a commercial look, and covers a lot of gear too expensive for the casual reader, and in general focuses on gear and other people's work. But it show me Processing. Processing has a horrible name for googleability, which used to be addressed by calling it Proce55ing. Idiotically they've assumed that because the google search for just processing by itself points to the proper website, they can stop using the distinctive 55 in the name. But what happens when you try combined searches for processing and some other search term? You get tons of site that use processing as a common English word.

flight404
Personal blog covering projects by the author of the site. He's done some really cool things with processing and also griffin powermate knobs.

Processing Blogs
Haven't really read this that much, but it looks interesting.

VLOBLIVE
It's a clunky word for 'Very Low Budget Live video for Events'. It's not that applicable to much that I do, and their definition of 'very low budget' is still a lot of money to me. They use the other terms like IMAG, for image magnification, which very mundanely just refers to show a big closeup of a performer on a stage on a big screen. The blog is pretty practical, not about cool art but just has a lot of helpful stuff.

There was another site linked to from Create Digital Motion but I don't have a link to it in front of me.

I've been playing with Processing, and it is very fast and easy to use. The support for microphone and video input doesn't seem as robust as in gephex, but the flexibility for making effects and taking data from other sources seems high. It's wierd, because a lot of the stuff to do is the sort of thing I'd do already in C++ and OSG rather than Java here- but I can understand the appeal to people who don't want to spend hours compiling the latest OSG sources, and there's few button and mouse clicks saved by just typing in code and hitting run. But I feel like I should learn it anyway even though its 3D capabilities are a step back from OSG, if nothing else because there's a higher likelihood of being able to collaborate with other people into processing.

2007-03-17

Vimeo

It's easy to spread yourself too thin by trying to maintain an online presence on a lot of similar community sites for hosting content. They all have different designs and by virtue of their architecture or just the vibe the creators and the initial group of users create they seem to be good for different things. But I'm trying out vimeo because of their focus on user created content- there's a lot of artists in there, and it sort of has a flickr feel to it- and the video quality is pretty good, the UI is nice that it disappears when not in use (though it obscures video when in use). I'm just hosting files identical to ones I have on myspace, google video, and youtube, but whatever site feels the most productive I'll probably eventually use to the exclusion of the rest. When someone starts a free 640x480 or HD hosting site I'll probably re-evaluate...

Youtube is the most popular, but video quality is garbage and most of the content is garbage. I imagine the user base is on the more youthful side.

Google video is better quality, though has no real community feel- it's just a faceless generic place to host video. Some day I might be interested in trying to make money off of uploaded video that I own entirely but for now that idea is mostly incompatible with my approach to this sort of thing (a tip jar feature with proceeds donated to a charity of my choosing would be nice though).

Myspace is not primarily a video sharing site, but they have a decent video uploading feature. If you have a myspace page and make video you might as well use their hosting instead of embedding someone else's. It can feel a lot more personal even if your page is not your personal page because of the emphasis on friending.

There's a ton of other hosting sites I won't bother with, mostly since their user base is marginal or they are just a dumping ground for copyrighted material, racier stuff if their content policy is more liberal than youtube or google's. Others are completely based around making money for uploaded content, pay per view basically: get thousands of views and make $10 or so. That sort of goal based emphasis probably marginalizes a lot of otherwise interesting content, encourages copy-cats and therefore homogeneity. So does having a view-counter or ratings (read slashdot for a few months to see how their 'karma' promotes pointless regurgitation...), but money is a force-multiplier.