Show Posts
|
Pages: [1]
|
1
|
General Category / Questions / Cannot delete bucket
|
on: May 09, 2008, 07:03:44 AM
|
I am not able to delete a bucket that has been created during a sync, the bucket is empty of files and has no sub-buckets but it still wont delete, the --dryrun tells me i am targetting the correct bucket but it still doesnt work.
I have the following structure /toplevel/sub1/sub2/sub3/problembucket/ and the fact i cannot remove the problembucket means i cannot delete anything above although i really need to.
Any ideas ?
|
|
|
2
|
General Category / Questions / Recent sync issues
|
on: April 08, 2008, 03:26:00 AM
|
My S3Sync has been running fine for a few months but has recently started erroring each day, heres a selection returned by the cron that runs each morning:
/etc/cron.s3sync/s3sync.php:
S3 command failed: put myserver/monday/dirs/_etc_valiases.tar.gz #<S3::S3Object:0xa97c668c> Content-Type application/x-gzip Content-Length 2566 With result 500 Internal Server Error 99 retries left Broken pipe: Broken pipe 98 retries left SSL Error: SSL_write:: bad write retry ...etc.... (works down to 0 retries left) SSL Error: SSL_write:: bad write retry 0 retries left Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! s3sync.rb:282:in `s3TreeRecurse': undefined method `http_response' for nil:NilClass (NoMethodError) from s3sync.rb:329:in `s3TreeRecurse' from s3sync.rb:310:in `each' from s3sync.rb:310:in `s3TreeRecurse' from s3sync.rb:329:in `s3TreeRecurse' from s3sync.rb:310:in `each' from s3sync.rb:310:in `s3TreeRecurse' from s3sync.rb:342:in `main' from ./thread_generator.rb:79:in `call' from ./thread_generator.rb:79:in `initialize' from ./thread_generator.rb:76:in `new' from ./thread_generator.rb:76:in `initialize' from s3sync.rb:263:in `new' from s3sync.rb:263:in `main' from s3sync.rb:721
-----------------------------------------------------------------------------------------------------
/etc/cron.s3sync/s3sync.php:
Connection reset: Connection reset by peer 99 retries left SSL Error: SSL_write:: bad write retry ...etc.... (works down to 0 retries left) Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! s3sync.rb:282:in `s3TreeRecurse': undefined method `http_response' for nil:NilClass (NoMethodError) from s3sync.rb:329:in `s3TreeRecurse' from s3sync.rb:310:in `each' from s3sync.rb:310:in `s3TreeRecurse' from s3sync.rb:329:in `s3TreeRecurse' from s3sync.rb:310:in `each' from s3sync.rb:310:in `s3TreeRecurse' from s3sync.rb:342:in `main' from ./thread_generator.rb:79:in `call' from ./thread_generator.rb:79:in `initialize' from ./thread_generator.rb:76:in `new' from ./thread_generator.rb:76:in `initialize' from s3sync.rb:263:in `new' from s3sync.rb:263:in `main' from s3sync.rb:721
-----------------------------------------------------------------------------------------------------
/etc/cron.s3sync/s3sync.php:
Broken pipe: Broken pipe 99 retries left SSL Error: SSL_write:: bad write retry ...etc.... (works down to 0 retries left) SSL Error: SSL_write:: bad write retry 0 retries left Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! Ran out of retries; operations did not complete! s3sync.rb:282:in `s3TreeRecurse': undefined method `http_response' for nil:NilClass (NoMethodError) from s3sync.rb:329:in `s3TreeRecurse' from s3sync.rb:310:in `each' from s3sync.rb:310:in `s3TreeRecurse' from s3sync.rb:329:in `s3TreeRecurse' from s3sync.rb:310:in `each' from s3sync.rb:310:in `s3TreeRecurse' from s3sync.rb:342:in `main' from ./thread_generator.rb:79:in `call' from ./thread_generator.rb:79:in `initialize' from ./thread_generator.rb:76:in `new' from ./thread_generator.rb:76:in `initialize' from s3sync.rb:263:in `new' from s3sync.rb:263:in `main' from s3sync.rb:721
To be honest i have no idea what any of this means, would really appreciate any help / advice.
Thanks.
|
|
|
3
|
General Category / Questions / sync from cron - ruby: command not found
|
on: December 13, 2007, 07:39:07 AM
|
Hi,
I have created a script for backing up to s3, this runs fine when invoked from the command line by myself just running ./sync_wednesday.sh but when i attempt to run this script from a cron like this:
01 06 * * 4 root run-parts /home/s3sync/syncscripts/sync_wednesday.sh
i get an email saying: /home/s3sync/syncscripts/sync_wednesday.sh: line 6: ruby: command not found
sync_wednesday.sh looks like this:
#!/bin/bash # script to upload local directory upto s3 cd /home/s3sync/s3sync/ export AWS_ACCESS_KEY_ID=55555555555555555555555 export AWS_SECRET_ACCESS_KEY=55555555555555555555555555555 export PATH=/usr/local/bin:$PATH ruby s3sync.rb -r --ssl --delete /backup/cpbackup/daily/ myBackup:serverName/wednesday/
the export PATH bit is just guesswork on my part, ruby is in that directory so i figured that might help but it doesnt.
any ideas?
|
|
|
6
|
General Category / Questions / Re: Problems using SSL
|
on: November 21, 2007, 06:51:14 AM
|
yep, i did that.
have tried pointing to both the folder and to individual files within and still get exactly the same error.
can anyone shed any light on what this error message actually means ?
|
|
|
8
|
General Category / Questions / Re: Problems using SSL
|
on: November 20, 2007, 04:37:13 AM
|
i tried using the certificate code from the readme.txt and named that certfile, i also exported all the certificates from the ssl.certs.shar file into the certs folder although admittedly i'm not 100% sure i did it right in either case, not sure how to check though tbh.
|
|
|
9
|
General Category / Questions / Re: Problems using SSL
|
on: November 19, 2007, 05:16:56 PM
|
yeah i tried that, when that didnt work i then moved onto using the SSL_CERT_FILE option, can you see any reason why the SSL_CERT_DIR option wouldnt work compared to your own usage ?
|
|
|
10
|
General Category / Questions / Re: Problems using SSL
|
on: November 19, 2007, 11:03:06 AM
|
i am also having problems running s3sync on SSL (ruby 1.8.6 (2007-11-18 patchlevel 5000) [i686-linux] on CentOS), i get this error:
./S3_s3sync_mod.rb:109:in `verify_mode=': undefined method `verify_mode=' for nil:NilClass (NoMethodError) from ./s3try.rb:46:in `s3trySetup' from s3sync.rb:108:in `main' from s3sync.rb:711
when running this code:
#!/bin/bash # script to upload local directory upto s3 cd /path/s3sync/s3sync/ export AWS_ACCESS_KEY_ID=111111111111111111111 export AWS_SECRET_ACCESS_KEY=KEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEY #export SSL_CERT_DIR=/path/s3sync/certs export SSL_CERT_FILE=/path/s3sync/certs/certfile ruby s3sync.rb -r --ssl /path/s3sync/localuploadfolder/ Jasons:pre/etcbackup # copy and modify line above for each additional folder to be synced
it works when i remove the --SSL option though ?
|
|
|
11
|
General Category / Questions / Create multiple backup buckets
|
on: November 19, 2007, 09:37:40 AM
|
Hi,
I would like to be able to create a number of backups within S3, e.g. Monday_01_01_07 / Tuesday_02_01_07 etc etc so i can create a series of backups for a week, when i hit 7 days i start deleting the oldest backup and replacing with a new one. There will be approx 10Gb of data so obviously i do not want to do a complete upload every day. Ideally I would copy the backup from the previous day and then s3sync to this, is this possible as i have seen no reference to a copy command for s3 or s3sync, if not does anyone have any idea how else this could be achieved.
thanks a lot.
.gee
|
|
|
|