S3Sync.net
February 02, 2014, 01:33:39 PM *
Welcome, Guest. Please login or register.

Login with username, password and session length
 
   Home   Help Search Login Register  
Pages: [1]
  Print  
Author Topic: Only syncing first sub-directory?  (Read 3039 times)
yanik
Newbie
*
Posts: 2


View Profile
« on: September 16, 2007, 06:46:55 AM »

Hi all,

I'm having this problem where only the first sub-directory of my source is getting synced.

I have a backup server (where my other servers backup) which I want to backup to S3 (so a backup of a backup). The structure is as follows:

Code:
/backups/server1
/backups/server2
/backups/server3


When I run the following:

Code:
ruby s3sync.rb -r -s -v /backups $BUCKET:$PREFIX

Only server1 gest synced. The sync works, ends normally (no error), but all other sub-directory (server2, server3, etc) never get touched. The target folders don't get created, the source folders don't get synced. The sync just stops after the first sub-directory.

Anything I'm missing?

Thanks
Logged
ferrix
Sr. Member
****
Posts: 363


(I am greg13070 on AWS forum)


View Profile
« Reply #1 on: September 16, 2007, 02:17:05 PM »

Looks right to me.  Can you create a miniature test case of directories that fail?  If so then tar them up and email to me (contact info in README)
Logged
yanik
Newbie
*
Posts: 2


View Profile
« Reply #2 on: September 18, 2007, 07:29:18 AM »

A bit more info...

I played a bit more with S3Sync and I don't think it necessarily stops on the first sub-directory. It'll sync one directory after the other until it hits one it can't sync (for whatever reason) and then it stops. It just happens that on my first try it stopped after the first directory. I pipe the S3Sync output to a log file and I see nothing special. No error message. It just stops.

One thing of interest (that may or may not explain my problem). All my servers backup to a backup server in a directory named backups (how many time can you say backup in one sentence?). Every night I take a snapshot of this directory (cp -al ...) and I (try to) S3Sync that snapshot. Can this be my problem? Would S3Sync stop on some hard links?

Here's the snapshot script I use:

Code:
#!/bin/bash
#Keep a snapshot of the last 30 days

MAX_DAYS=30
BACKUP_PATH="/backups"

rm -rf $BACKUP_PATH.30

for ((X=$MAX_DAYS; X > 1; X--))
do
        mv $BACKUP_PATH.$(($X-1)) $BACKUP_PATH.$X
done

cp -al $BACKUP_PATH/. $BACKUP_PATH.1
Logged
ferrix
Sr. Member
****
Posts: 363


(I am greg13070 on AWS forum)


View Profile
« Reply #3 on: September 18, 2007, 05:09:54 PM »

None of that seems like it should be a problem.  There's no way for the code to just exit without some kind of error.. try with the -d option and maybe get some idea of what operation was pending when it "stops"?
Logged
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2013, Simple Machines Valid XHTML 1.0! Valid CSS!