Ferrix meet Randy, Randy meet Ferrix.

It woul be _great_ if your tools played with each other. I'm using s3sync to mirror EC2 instances and would like to be able to mount S3 buckets to access the same content using s3fs. Unfortunately the file/folder conventions aren't compatible.

Anything you can do?

Posting to http://code.google.com/p/s3fs/issues/ and http://s3sync.net/forum

Best
   .M.

Nope you're fine.  Are you sure it's "processing" them, or just making a node for the directory and then skipping its contents?  Because that's what your regex is telling it to do.

If you want to skip the folder itself, as well as its contents, you should trail with /|$  instead of just /
(that's "slash, or the end of the string")

This is not working for me. This isn't skipping .svn folders, it's skipping

What does the trailing |$ supposed to do? The following cmd is excluding all subdirectories.

./s3sync.rb -rd --delete --progress --exclude="\.svn/|$" -n  /etc <bucket>:


Here's the debug from a test folder structure I created

localTreeRecurse /tmp/testing
Test /tmp/testing/bli1
Test /tmp/testing/bli3
Test /tmp/testing/bli2
Test /tmp/testing/.svn
Adding it as a dir node
skipping local item /.svn because of --exclude
.svn is a dir node
skipping local item /.svn because of --exclude
skipping local item /bli1 because of --exclude
skipping local item /bli2 because of --exclude
skipping local item /bli3 because of --exclude

In this example (according to your post) the following would be synch'ed

testing/
 bli1
 bli2
 bli3

and the following would be skipped

testing/
 .svn/
  blah1
  blah2
  blah3

but all you get is a file node 'testing'

Ah ok, I understand what's going on.. trac was a non-existent file.

This command

./s3sync.rb -rd  /user/share/trac <bucket>:user/share

produced a node /user/share/trac even though /user/share/trac doesn't exist (user, not usr, was typo)

This behavior is confusing. It would be better if there was a debug write reflecting the Linux error message (e.g. "/user/share/trac: No such file or directory")

and no node was produced. I can't see the point of creating a node in this instance and typos/incorrect usage will clog up people's buckets.

Thanks 
   .M.

Hi, I'm getting inconsistent behavior trying to mirror files to S3.  After the following, /etc seems to be mirrored correctly. /home is mirrored but no symlinks are followed. Just the file is stored for the symlinked dir. And /usr/share/trac (dir) is stored as a file.



./s3sync.rb -rd  /etc <bucket>:

./s3sync.rb -rd  /home <bucket>:

./s3sync.rb -rd  /user/share/trac <bucket>:user/share

where <bucket> is name of bucket

Any ideas why the latter? Perms look fine.

Thanks
   .M.

Thanks agbert

RTFM - Read The Ferrix's Mind...

{;-)
   .M.

Hi

Is there any documentation on the --delete syntax? Or any of the other options for that matter?

I for one could really use more examples and a oneliner on each of the options for s3sync.

Happy to contribute some of my notes to the wiki as I go but don't want to edit the homepage without checking first.

A bit weird that the best doco is elsewhere
http://developer.amazonwebservices.com/connect/entry.jspa?externalID=931&categoryID=100

But thanks for what looks like a very useful tool!

Cheers
  .M.