S3Sync.net
February 02, 2014, 01:27:58 PM *
Welcome, Guest. Please login or register.

Login with username, password and session length
 
  Home Help Search Login Register  
  Show Posts
Pages: [1]
1  General Category / Questions / Cannot delete bucket on: May 09, 2008, 07:03:44 AM
I am not able to delete a bucket that has been created during a sync, the bucket is empty of files and has no sub-buckets but it still wont delete, the --dryrun tells me i am targetting the correct bucket but it still doesnt work.

I have the following structure /toplevel/sub1/sub2/sub3/problembucket/ and the fact i cannot remove the problembucket means i cannot delete anything above although i really need to.

Any ideas ?
2  General Category / Questions / Recent sync issues on: April 08, 2008, 03:26:00 AM
My S3Sync has been running fine for a few months but has recently started erroring each day, heres a selection returned by the cron that runs each morning:

/etc/cron.s3sync/s3sync.php:

S3 command failed:
put myserver/monday/dirs/_etc_valiases.tar.gz #<S3::S3Object:0xa97c668c> Content-Type application/x-gzip Content-Length 2566
With result 500 Internal Server Error
99 retries left
Broken pipe: Broken pipe
98 retries left
SSL Error: SSL_write:: bad write retry
...etc.... (works down to 0 retries left)
SSL Error: SSL_write:: bad write retry
0 retries left
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
s3sync.rb:282:in `s3TreeRecurse': undefined method `http_response' for nil:NilClass (NoMethodError)
   from s3sync.rb:329:in `s3TreeRecurse'
   from s3sync.rb:310:in `each'
   from s3sync.rb:310:in `s3TreeRecurse'
   from s3sync.rb:329:in `s3TreeRecurse'
   from s3sync.rb:310:in `each'
   from s3sync.rb:310:in `s3TreeRecurse'
   from s3sync.rb:342:in `main'
   from ./thread_generator.rb:79:in `call'
   from ./thread_generator.rb:79:in `initialize'
   from ./thread_generator.rb:76:in `new'
   from ./thread_generator.rb:76:in `initialize'
   from s3sync.rb:263:in `new'
   from s3sync.rb:263:in `main'
   from s3sync.rb:721



-----------------------------------------------------------------------------------------------------

/etc/cron.s3sync/s3sync.php:

Connection reset: Connection reset by peer
99 retries left
SSL Error: SSL_write:: bad write retry
...etc.... (works down to 0 retries left)
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
s3sync.rb:282:in `s3TreeRecurse': undefined method `http_response' for nil:NilClass (NoMethodError)
   from s3sync.rb:329:in `s3TreeRecurse'
   from s3sync.rb:310:in `each'
   from s3sync.rb:310:in `s3TreeRecurse'
   from s3sync.rb:329:in `s3TreeRecurse'
   from s3sync.rb:310:in `each'
   from s3sync.rb:310:in `s3TreeRecurse'
   from s3sync.rb:342:in `main'
   from ./thread_generator.rb:79:in `call'
   from ./thread_generator.rb:79:in `initialize'
   from ./thread_generator.rb:76:in `new'
   from ./thread_generator.rb:76:in `initialize'
   from s3sync.rb:263:in `new'
   from s3sync.rb:263:in `main'
   from s3sync.rb:721




-----------------------------------------------------------------------------------------------------


/etc/cron.s3sync/s3sync.php:

Broken pipe: Broken pipe
99 retries left
SSL Error: SSL_write:: bad write retry
...etc.... (works down to 0 retries left)
SSL Error: SSL_write:: bad write retry
0 retries left
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
Ran out of retries; operations did not complete!
s3sync.rb:282:in `s3TreeRecurse': undefined method `http_response' for nil:NilClass (NoMethodError)
   from s3sync.rb:329:in `s3TreeRecurse'
   from s3sync.rb:310:in `each'
   from s3sync.rb:310:in `s3TreeRecurse'
   from s3sync.rb:329:in `s3TreeRecurse'
   from s3sync.rb:310:in `each'
   from s3sync.rb:310:in `s3TreeRecurse'
   from s3sync.rb:342:in `main'
   from ./thread_generator.rb:79:in `call'
   from ./thread_generator.rb:79:in `initialize'
   from ./thread_generator.rb:76:in `new'
   from ./thread_generator.rb:76:in `initialize'
   from s3sync.rb:263:in `new'
   from s3sync.rb:263:in `main'
   from s3sync.rb:721


To be honest i have no idea what any of this means, would really appreciate any help / advice.

Thanks.
3  General Category / Questions / sync from cron - ruby: command not found on: December 13, 2007, 07:39:07 AM
Hi,

I have created a script for backing up to s3, this runs fine when invoked from the command line by myself just running ./sync_wednesday.sh but when i attempt to run this script from a cron like this:

01 06 * * 4 root run-parts /home/s3sync/syncscripts/sync_wednesday.sh

i get an email saying:
/home/s3sync/syncscripts/sync_wednesday.sh: line 6: ruby: command not found

sync_wednesday.sh looks like this:

#!/bin/bash
# script to upload local directory upto s3
cd /home/s3sync/s3sync/
export AWS_ACCESS_KEY_ID=55555555555555555555555
export AWS_SECRET_ACCESS_KEY=55555555555555555555555555555
export PATH=/usr/local/bin:$PATH
ruby s3sync.rb -r --ssl --delete /backup/cpbackup/daily/  myBackup:serverName/wednesday/


the export PATH bit is just guesswork on my part, ruby is in that directory so i figured that might help but it doesnt.

any ideas?

4  General Category / Questions / Re: Problems using SSL on: November 21, 2007, 07:58:32 AM
i have now checked the validity of the certificate using http://prefetch.net/articles/checkcertificate.html and the certificate is valid. Is this a case of ruby not trusting the certificate or something like that ?
5  General Category / Questions / Re: Create multiple backup buckets on: November 21, 2007, 06:53:45 AM
hmmm..

thats an interesting idea which i might look into actually.

thanks a lot.
6  General Category / Questions / Re: Problems using SSL on: November 21, 2007, 06:51:14 AM
yep, i did that.

have tried pointing to both the folder and to individual files within and still get exactly the same error.

can anyone shed any light on what this error message actually means ?
7  General Category / Questions / Re: Create multiple backup buckets on: November 20, 2007, 04:54:29 AM
thanks for your response. That does seem to be a major issue for me, i will have to look elsewhere for a remote backup solution unless there is some kind of workaround.
8  General Category / Questions / Re: Problems using SSL on: November 20, 2007, 04:37:13 AM
i tried using the certificate code from the readme.txt and named that certfile, i also exported all the certificates from the ssl.certs.shar file into the certs folder although admittedly i'm not 100% sure i did it right in either case, not sure how to check though tbh.
9  General Category / Questions / Re: Problems using SSL on: November 19, 2007, 05:16:56 PM
yeah i tried that, when that didnt work i then moved onto using the SSL_CERT_FILE option, can you see any reason why the SSL_CERT_DIR option wouldnt work compared to your own usage ?
10  General Category / Questions / Re: Problems using SSL on: November 19, 2007, 11:03:06 AM
i am also having problems running s3sync on SSL (ruby 1.8.6 (2007-11-18 patchlevel 5000) [i686-linux] on CentOS), i get this error:

./S3_s3sync_mod.rb:109:in `verify_mode=': undefined method `verify_mode=' for nil:NilClass (NoMethodError)
        from ./s3try.rb:46:in `s3trySetup'
        from s3sync.rb:108:in `main'
        from s3sync.rb:711


when running this code:

#!/bin/bash
# script to upload local directory upto s3
cd /path/s3sync/s3sync/
export AWS_ACCESS_KEY_ID=111111111111111111111
export AWS_SECRET_ACCESS_KEY=KEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEY
#export SSL_CERT_DIR=/path/s3sync/certs
export SSL_CERT_FILE=/path/s3sync/certs/certfile
ruby s3sync.rb -r --ssl  /path/s3sync/localuploadfolder/ Jasons:pre/etcbackup
# copy and modify line above for each additional folder to be synced


it works when i remove the --SSL option though ?
11  General Category / Questions / Create multiple backup buckets on: November 19, 2007, 09:37:40 AM
Hi,

I would like to be able to create a number of backups within S3, e.g. Monday_01_01_07  / Tuesday_02_01_07 etc etc so i can create a series of backups for a week, when i hit 7 days i start deleting the oldest backup and replacing with a new one. There will be approx 10Gb of data so obviously i do not want to do a complete upload every day. Ideally I would copy the backup from the previous day and then s3sync to this, is this possible as i have seen no reference to a copy command for s3  or s3sync, if not does anyone have any idea how else this could be achieved.

thanks a lot.

.gee
Pages: [1]
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2013, Simple Machines Valid XHTML 1.0! Valid CSS!