Sample Header Ad - 728x90

Unix & Linux Stack Exchange

Q&A for users of Linux, FreeBSD and other Unix-like operating systems

Latest Questions

3 votes
1 answers
2294 views
Wildcards in exclude-filelist for duplicity
I am trying to exclude a "bulk" folder in each home directory from the backup. For this purpose, I have a line - /data/home/*/bulk in my exclude-filelist file. However, this doesn't seem to be recognised: Warning: file specification '/data/home/*/bulk' in filelist exclude-list-test.txt doesn't start...
I am trying to exclude a "bulk" folder in each home directory from the backup. For this purpose, I have a line - /data/home/*/bulk in my exclude-filelist file. However, this doesn't seem to be recognised: Warning: file specification '/data/home/*/bulk' in filelist exclude-list-test.txt doesn't start with correct prefix /data/home/kay/bulk. Ignoring. Is there a way? BTW: is the format in general compatible with rsync's exclude-from? I have a working exclude list for that, where this wildcard expression works.
mcandril (273 rep)
Oct 6, 2014, 11:30 AM • Last activity: Jun 29, 2025, 09:00 PM
7 votes
1 answers
6413 views
iconv module (to use with rsync) to avoid windows-illegal filenames in local NTFS partition
I would like to locally attach an NTFS volume to my unix (Ubuntu) machine, and copy (replicate) some unix directories to it, using rsync, in a way that the result is readable under Windows. I do not care about ownership and permissions. It would be nice if modification dates would be preserved. I on...
I would like to locally attach an NTFS volume to my unix (Ubuntu) machine, and copy (replicate) some unix directories to it, using rsync, in a way that the result is readable under Windows. I do not care about ownership and permissions. It would be nice if modification dates would be preserved. I only need directories and files (symbolic links would be nice, too; but not a problem if they cannot be copied). Two obvious problems are: case (in)sensitivity, and characters that are illegal in Windows filenames. For example, in Linux I can have two files "a" and "A"; I can copy them to the NTFS volume, but in Windows I will be able to access (at most?) one of them. But I am happy to ignore that problem. What I am interested about are illegal characters in Windows filenames, which are ,:,",/,\\,|,?, and * (well, actually also ascii 0-31, but I do not care about that. There might also be problems with files ending in a "."?). I would like rsync to automatically "rename", e.g., a file called "a:" to, say a(COLON), to end up with a legal name (and, ideally, translate a(COLON) back to a:) **Is this possible to have rsync automatically rename files to avoid characters forbidden in Windows?** - As far as I understand rsync can use **iconv** to do such tasks; is there a standard iconv module for windows-filenames? (I briefly looked into programming an own gconv module, but lacking C knowlege this seems too complicated). - I have been told that **rdiff-backup** can do some conversions like that, but the homepage just mentions something being done "automatically", and I am not sure whether a locally mounted NTFS vomlume would trigger a renaming in a reliable way? - I am aware that there is **fuse-posixovl**, but this seems an overkill for my purpose, and also it doesn't seem to be well documented (which characters will be translated in which way? Will all filenames be truncated to 8.3 or whatever? Can I avoid the additional files carrying owner/permission information, which I will not need, etc etc.) - I am aware that I could avoid all these problems by using, e.g., a **tar** file; but this is not what I want. (In particular, I would like in Windows to further replicate from the NTFS volume to another backup partition, copying only the changed files) - I am aware of the "**windows_names**" option when mounting NTFS; but this will prevent creating offending files, not rename them. **Update:** As it seems my question was not quite clear, let me give a more explicit example: For example, WINDOWS-1251 is of no use for me. iconv -f utf-8 -t WINDOWS-1251//TRANSLIT transforms 123 abc ABC äö &::*"\\|?][^/]*' # find stuff containing dot as last character (supposedly bad for windows) find $MYDIR -regex '.*\.' # find stuff that is identical case insensitive find $MYDIR -print0 | sort -z | uniq -diz | tr '\0' '\n' (the last line is from https://unix.stackexchange.com/questions/22870/case-insensitive-search-of-duplicate-file-names/ )
Jakob (171 rep)
Feb 7, 2017, 02:53 PM • Last activity: Jun 24, 2025, 07:10 AM
2 votes
3 answers
800 views
rdiff-backup needs too much space to recover from failure of previous backup?
I have quite a lot of free space (and inodes) on this filesystem, but `rdiff-backup` apparently runs out of space. And hence my backups are not working at the moment :-(. Why? (I wonder how much space I should be reserving for this in future!) My rdiff-backup is version `1.2.8-7`. My OS is Debian 9...
I have quite a lot of free space (and inodes) on this filesystem, but rdiff-backup apparently runs out of space. And hence my backups are not working at the moment :-(. Why? (I wonder how much space I should be reserving for this in future!) My rdiff-backup is version 1.2.8-7. My OS is Debian 9 "stretch". # df -h /d/backup Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_brick-lv_backup 139G 95G 38G 72% /d/backup # df -i /d/backup Filesystem Inodes IUsed IFree IUse% Mounted on /dev/mapper/vg_brick-lv_backup 9240576 413341 8827235 5% /d/backup # df -h Filesystem Size Used Avail Use% Mounted on udev 244M 0 244M 0% /dev tmpfs 51M 1.9M 49M 4% /run /dev/sda7 15G 4.1G 9.8G 30% / tmpfs 251M 0 251M 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 251M 0 251M 0% /sys/fs/cgroup /dev/ubi0_0 462M 225M 233M 50% /d/ubi tmpfs 251M 4.0K 251M 1% /tmp /dev/mapper/vg_brick-lv_attic 44G 21G 21G 50% /d/attic /dev/mapper/vg_brick-lv_backup 139G 95G 38G 72% /d/backup /dev/sda6 2.0G 81M 1.8G 5% /boot /dev/mapper/vg_brick-lv_home 134G 91G 37G 71% /home /dev/sda10 9.8G 2.9G 6.9G 30% /d/xfer tmpfs 51M 0 51M 0% /run/user/1003 root@brick:/d/backup/jenkins-desktop# du -sh mike 5.7G mike root@brick:/d/backup/jenkins-desktop# du -sh ../jenkins-desktop.rdiff/mike 8.2G ../jenkins-desktop.rdiff/mike root@brick:/d/backup/jenkins-desktop# rdiff-backup mike ../jenkins-desktop.rdiff/mike Previous backup seems to have failed, regressing destination now. Exception '[Errno 28] No space left on device' raised of class '': File "/usr/lib/python2.7/dist-packages/rdiff_backup/robust.py", line 32, in check_common_error try: return function(*args) File "/usr/lib/python2.7/dist-packages/rdiff_backup/restore.py", line 468, in get_fp Rdiff.write_patched_fp(current_fp, delta_fp, new_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Rdiff.py", line 73, in write_patched_fp rpath.copyfileobj(librsync.PatchedFile(basis_fp, delta_fp), out_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/rpath.py", line 64, in copyfileobj outputfp.write(inbuf) Exception '[Errno 28] No space left on device' raised of class '': File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 304, in error_check_Main try: Main(arglist) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 324, in Main take_action(rps) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 280, in take_action elif action == "backup": Backup(rps, rps) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 337, in Backup backup_final_init(rpout) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 501, in backup_final_init checkdest_if_necessary(rpout) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 920, in checkdest_if_necessary dest_rp.conn.regress.Regress(dest_rp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line 71, in Regress for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf) File "/usr/lib/python2.7/dist-packages/rdiff_backup/rorpiter.py", line 281, in __call__ last_branch.fast_process(*args) File "/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line 268, in fast_process if rf.metadata_rorp.isreg(): self.restore_orig_regfile(rf) File "/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line 290, in restore_orig_regfile tf.write_from_fileobj(rf.get_restore_fp()) File "/usr/lib/python2.7/dist-packages/rdiff_backup/restore.py", line 488, in get_restore_fp return robust.check_common_error(error_handler, get_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/robust.py", line 32, in check_common_error try: return function(*args) File "/usr/lib/python2.7/dist-packages/rdiff_backup/restore.py", line 468, in get_fp Rdiff.write_patched_fp(current_fp, delta_fp, new_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Rdiff.py", line 73, in write_patched_fp rpath.copyfileobj(librsync.PatchedFile(basis_fp, delta_fp), out_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/rpath.py", line 64, in copyfileobj outputfp.write(inbuf) Traceback (most recent call last): File "/usr/bin/rdiff-backup", line 30, in rdiff_backup.Main.error_check_Main(sys.argv[1:]) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 304, in error_check_Main File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 324, in Main take_action(rps) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 280, in take_action elif action == "backup": Backup(rps, rps) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 337, in Backup backup_final_init(rpout) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 501, in backup_final_init checkdest_if_necessary(rpout) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py", line 920, in checkdest_if_necessary dest_rp.conn.regress.Regress(dest_rp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line 71, in Regress for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf) File "/usr/lib/python2.7/dist-packages/rdiff_backup/rorpiter.py", line 281, in __call__ last_branch.fast_process(*args) File "/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line 268, in fast_process if rf.metadata_rorp.isreg(): self.restore_orig_regfile(rf) File "/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line 290, in restore_orig_regfile tf.write_from_fileobj(rf.get_restore_fp()) File "/usr/lib/python2.7/dist-packages/rdiff_backup/restore.py", line 488, in get_restore_fp return robust.check_common_error(error_handler, get_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/robust.py", line 32, in check_common_error try: return function(*args) File "/usr/lib/python2.7/dist-packages/rdiff_backup/restore.py", line 468, in get_fp Rdiff.write_patched_fp(current_fp, delta_fp, new_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/Rdiff.py", line 73, in write_patched_fp rpath.copyfileobj(librsync.PatchedFile(basis_fp, delta_fp), out_fp) File "/usr/lib/python2.7/dist-packages/rdiff_backup/rpath.py", line 64, in copyfileobj outputfp.write(inbuf) IOError: [Errno 28] No space left on device
sourcejedi (53222 rep)
Dec 3, 2018, 06:51 PM • Last activity: Jan 15, 2024, 05:22 PM
0 votes
0 answers
37 views
Check if Files Where Updated on HDD Without Spin-Up
I am looking for a way to check if files were added/deleted/updated on a network shared HDD without spinning it up if possible. First I will start with my set up. I have an Asus Router (running Merlin) with a 3.0 usb port connected to a HDD (call it HDD1) shared using the build in Samba share. I the...
I am looking for a way to check if files were added/deleted/updated on a network shared HDD without spinning it up if possible. First I will start with my set up. I have an Asus Router (running Merlin) with a 3.0 usb port connected to a HDD (call it HDD1) shared using the build in Samba share. I then have a raspberry pi 3 (only with usb 2.0 ports) connected to the router through ethernet. The pi also has its own HDD (call it HDD2) connected to it. I have HDD2 as a backup of HDD1 using rdiff-backup and the HDD1 mounted to a folder within the pi. Using a cronjob, I have weekly backups made. I noticed though when calling rdiff-backup to do a check, it has to spin up both drives even if there is no change. May not be much but to strive for the most life long drive, I would like it to spin up less, especially if I have not touched the shared drive in say weeks. My initial thoughts were to use something like inotify to make the calls to rdiff-backup only when files change but reading the man page, it does not work over the network and has to do "polling" to check. Doesn't really solve the issue and the derivatives to inotify all seem to build off of it, which entails still not working over network. My second idea is to add some script to the router that makes some call to the pi when the hard drive has any file changes and then the pi would know to maybe later that night to do a rdiff-backup sync, but I feel that is over complicating the situation and I don't yet have a full plan of how I would do that. Third option is to have both hard drives connected to the pi, but then I am limited to 2.0 usb speeds. Does anyone have any idea's/suggestions?
Kayracer (31 rep)
Jul 31, 2021, 03:55 AM
0 votes
1 answers
86 views
mergerfs no longer accepting "threads=2" option
I wrote my backup script to automatically combine two external drives into one with mergerfs so I could use the whole thing as a destination directory for rdiff-backup. However, when I tried to run it recently I get the error: fuse: unknown option `threads=2' The "threads" option appears in the [man...
I wrote my backup script to automatically combine two external drives into one with mergerfs so I could use the whole thing as a destination directory for rdiff-backup. However, when I tried to run it recently I get the error: fuse: unknown option `threads=2' The "threads" option appears in the man pages so I'm not sure what I'm missing here. For reference this is my current mergerfs command that's failing: mergerfs -o use_ino,category.create=mfs,threads=2 ...
SurpriseDog (662 rep)
Mar 10, 2021, 03:45 PM • Last activity: Mar 15, 2021, 04:55 PM
0 votes
0 answers
167 views
Recover files deleted by rdiff-backup
I used the following `rdiff-backup` command to backup my home directory onto a mounted drive `/run/media/me/bku`. rdiff-backup -v 9 --force --include /home/me/ --exclude '**' / /run/media/me/bku At the destination there were other directories and files present: ls /run/media/me/bku dir1 dir2 Upon co...
I used the following rdiff-backup command to backup my home directory onto a mounted drive /run/media/me/bku. rdiff-backup -v 9 --force --include /home/me/ --exclude '**' / /run/media/me/bku At the destination there were other directories and files present: ls /run/media/me/bku dir1 dir2 Upon completion, I noticed that all the files I had at the destination have been removed entirely. 2020-11-04 16:19:01.560098 -0500 Removing directory /run/media/me/bku/dir1 Is this a normal behavior for rdiff-backup? Also, is there a way to recover those deleted files?
slybloty (1318 rep)
Nov 4, 2020, 11:31 PM
2 votes
1 answers
1779 views
Checking destination directory after "No space left on device" error
My latest backup attempt with `rdiff-backup` failed due to `"[Errno 28] No space left on device"`. And it's true, according to `du` there are 0 bytes available on the backup device. When I now try to revert the directory to the state before the unsuccessful session by simply starting another backup...
My latest backup attempt with rdiff-backup failed due to "[Errno 28] No space left on device". And it's true, according to du there are 0 bytes available on the backup device. When I now try to revert the directory to the state before the unsuccessful session by simply starting another backup attempt, I also get [Errno 28]. The next idea I had was to get rid of some old backup increments to gain some fresh disk space. To see the list of backup increments, I invoked rdiff-backup -l mirror_dir which results in Fatal Error: Previous backup to mirror_dir seems to have failed. Rerun rdiff-backup with --check-destination-dir option to revert directory to state before unsuccessful session. Then I did what the message told me and ran rdiff-backup --check-destination-dir mirror_dir which again gives me the now already famous [Errno 28]. It seems like I am in a dead end, where I cannot do *anything* anymore, not even free some disk space which action seems to be the only solution to this problem. Is there a way out of this situation?
zepp133 (565 rep)
Jun 4, 2015, 09:17 PM • Last activity: Mar 23, 2019, 05:01 PM
0 votes
1 answers
1288 views
rsnapshot backup not working?
I installed `rsnapshot` and configured it to make backup every hour. But the issue is all backups that are made not working. Let me explain to you, I made 3 backups `hourly.0`, `hourly.1` and `hourly.2`. - hourly.0 : there are 15 files - hourly.1 : there are 14 files (I removed one file) - hourly.2...
I installed rsnapshot and configured it to make backup every hour. But the issue is all backups that are made not working. Let me explain to you, I made 3 backups hourly.0, hourly.1 and hourly.2. - hourly.0 : there are 15 files - hourly.1 : there are 14 files (I removed one file) - hourly.2 : there are 15 files (I recreated an other file) The problem is when I went to backup of hourly.1 I found the file that I created in hourly.2, so I tried to remove it again but unfortunately the file that I removed ended up being removed in all my folders (hourly.0, hourly.1 and hourly.3), which means the all of those folders are just a symbolic links not more. This is my file configuration: #rsnapshot config_version 1.2 snapshot_root /var/Majjane-Save/ cmd_cp /bin/cp cmd_rm /bin/rm cmd_rsync /usr/bin/rsync cmd_logger /usr/bin/logger cmd_du /usr/bin/du cmd_rsnapshot_diff /usr/bin/rsnapshot-diff retain hourly 24 verbose 2 loglevel 3 logfile /var/log/rsnapshot.log lockfile /var/run/rsnapshot.pid exclude /var/www/clients/ exclude /var/www/apps/ backup /var/www/ localhost/var/Majjane-Save/ Note : i solved the issue , in the fact it was about the symbolic links. i were run the backup just the symbolic links no more. now its work well.
BAHADDOU Mohammed (13 rep)
May 12, 2015, 10:26 PM • Last activity: Mar 9, 2019, 09:19 AM
3 votes
1 answers
1166 views
--remote-schema option for rdiff-backup
I'm running the following command: rdiff-backup --remote-schema '%s' 'sudo /usr/bin/rdiff-backup --server \ --restrict-read-only /'::/etc /var/backups/hosts/derp It's backing up `/etc` from `localhost` and putting it in `/var/backups/hosts/derp` just fine. I have no idea how to get this to run and p...
I'm running the following command: rdiff-backup --remote-schema '%s' 'sudo /usr/bin/rdiff-backup --server \ --restrict-read-only /'::/etc /var/backups/hosts/derp It's backing up /etc from localhost and putting it in /var/backups/hosts/derp just fine. I have no idea how to get this to run and pull the files from another host.
Ben Preston (304 rep)
May 27, 2011, 03:22 AM • Last activity: Nov 17, 2018, 12:15 AM
0 votes
1 answers
343 views
Found too many current_mirror incs!
After upgrading my rdiff backup rdiff-backup --version rdiff-backup 1.2.8 i get the following error message: Exception 'Found too many current_mirror incs!' raised of class ' ': **How would i find out which directory is having the issue?**
After upgrading my rdiff backup rdiff-backup --version rdiff-backup 1.2.8 i get the following error message: Exception 'Found too many current_mirror incs!' raised of class '': **How would i find out which directory is having the issue?**
Wolfgang Fahl (497 rep)
Nov 16, 2018, 07:41 AM • Last activity: Nov 16, 2018, 09:16 AM
0 votes
1 answers
2010 views
Install rdiff-backup on centos 7
I'm having trouble installing rdiff backup on Centos 7. Every google search is telling to get this `https://dl.fedoraproject.org/pub/epel/7/x86_64/r/rdiff-backup-1.2.8-11.el7.x86_64.rpm` [one way][1] or [the other][2] but it yields a 404. So I tried installing development tools and building it from...
I'm having trouble installing rdiff backup on Centos 7. Every google search is telling to get this https://dl.fedoraproject.org/pub/epel/7/x86_64/r/rdiff-backup-1.2.8-11.el7.x86_64.rpm one way or the other but it yields a 404. So I tried installing development tools and building it from source. python --version Python 2.7.5 python setup.py install running install running build running build_py creating build creating build/lib.linux-x86_64-2.7 creating build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/backup.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/robust.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/iterfile.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/user_group.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/lazy.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/increment.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/log.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/FilenameMapping.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/fs_abilities.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/regress.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/statistics.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/rpath.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/manage.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/metadata.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/TempFile.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/Rdiff.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/restore.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/static.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/Main.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/Time.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/hash.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/eas_acls.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/rorpiter.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/Hardlink.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/Globals.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/SetConnections.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/selection.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/Security.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/connection.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/__init__.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/librsync.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/win_acls.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/compare.py -> build/lib.linux-x86_64-2.7/rdiff_backup copying rdiff_backup/longname.py -> build/lib.linux-x86_64-2.7/rdiff_backup running build_ext building 'rdiff_backup.C' extension creating build/temp.linux-x86_64-2.7 gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python2.7 -c cmodule.c -o build/temp.linux-x86_64-2.7/cmodule.o cmodule.c:24:20: fatal error: Python.h: No such file or directory #include ^ compilation terminated. error: command 'gcc' failed with exit status 1 The build fails. No idea if it has something to do with 2009 or something else, but man this is annoying. This worked a few months ago on my old box.
sfxworks (103 rep)
Oct 10, 2018, 06:26 AM • Last activity: Oct 10, 2018, 06:40 AM
0 votes
1 answers
141 views
rdiff-backup - backup folder smaller than the original / error when restoring files
I'm testing rdiff-backup and I thought maybe someone could help me out. 1: Why is my backup smaller than the original folder? In my remote server I have 36G and in my backup server it's only 29G. 2: I was trying to restore some files but I got this error: Exception '[Errno 13] Permission denied: '/h...
I'm testing rdiff-backup and I thought maybe someone could help me out. 1: Why is my backup smaller than the original folder? In my remote server I have 36G and in my backup server it's only 29G. 2: I was trying to restore some files but I got this error: Exception '[Errno 13] Permission denied: '/home/brt/backups2/rdiff-backup.tmp.0'' raised of class '': File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 304, in error_check_Main try: Main(arglist) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 324, in Main take_action(rps) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 290, in take_action elif action == "restore-as-of": Restore(rps, rps, 1) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 554, in Restore dest_rp.conn.fs_abilities.restore_set_globals(dest_rp) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/connection.py", line 450, in __call__ return apply(self.connection.reval, (self.name,) + args) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/connection.py", line 370, in reval if isinstance(result, Exception): raise result Traceback (most recent call last): File "/usr/local/bin/rdiff-backup", line 30, in rdiff_backup.Main.error_check_Main(sys.argv[1:]) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 304, in error_check_Main try: Main(arglist) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 324, in Main take_action(rps) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 290, in take_action elif action == "restore-as-of": Restore(rps, rps, 1) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line 554, in Restore dest_rp.conn.fs_abilities.restore_set_globals(dest_rp) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/connection.py", line 450, in __call__ return apply(self.connection.reval, (self.name,) + args) File "/usr/local/lib/python2.7/site-packages/rdiff_backup/connection.py", line 370, in reval if isinstance(result, Exception): raise result OSError: [Errno 13] Permission denied: '/home/brt/backups2/rdiff-backup.tmp.0' Fatal Error: Lost connection to the remote system What happened and how can I fix it? Thank you.
Asdra (23 rep)
Jul 13, 2018, 07:57 PM • Last activity: Jul 13, 2018, 09:21 PM
5 votes
0 answers
291 views
How are XFS deltas for xfsdump -l n calculated?
I have a xfs filesystem with many small and a couple very large files (~100GB), its on a lvm2 volume. I want to do incremental backups from it. Is there any computational overhead when using a tool like for example duplicity/rdiff versus xfsdump for the backups ? In short will xfsdump reuse some fs...
I have a xfs filesystem with many small and a couple very large files (~100GB), its on a lvm2 volume. I want to do incremental backups from it. Is there any computational overhead when using a tool like for example duplicity/rdiff versus xfsdump for the backups ? In short will xfsdump reuse some fs internal information to significantly reduce the work it has to do to get the deltas or can I as well use something with nice features without significant performance penalties ?
rtur (51 rep)
Jul 29, 2015, 04:59 PM
0 votes
2 answers
1843 views
rdiff-backup operation not permitted
#Objective# I'm trying to execute the following command in my Python script: > rdiff-backup --terminal-verbosity=5 --remote-schema "ssh %s -p1019 -i > C:/Users/Adam/.ssh/private-passphrase rdiff-backup --server" > C:/Users/Adam/Desktop pi@192.168.0.125::/media/exthdd1/backup My source directory is f...
#Objective# I'm trying to execute the following command in my Python script: > rdiff-backup --terminal-verbosity=5 --remote-schema "ssh %s -p1019 -i > C:/Users/Adam/.ssh/private-passphrase rdiff-backup --server" > C:/Users/Adam/Desktop pi@192.168.0.125::/media/exthdd1/backup My source directory is from a Windows OS and my target directory is a Debian based system. #Problem# I get this output: `Using rdiff-backup version 1.2.8 Executing ssh pi@192.168.0.125 -p1019 -i C:/Users/Adam/.ssh/private-passphrase r diff-backup --server Enter passphrase for key 'C:/Users/Adam/.ssh/private-passphrase': Found interrupted initial backup. Removing... Hardlinks disabled by default on Windows Unable to import module xattr. Extended attributes not supported on filesystem at C:/Users/Adam/Desktop Unable to import module posix1e from pylibacl package. POSIX ACLs not supported on filesystem at C:/Users/Adam/Desktop escape_dos_devices not required by filesystem at C:/Users/Adam/Desktop ----------------------------------------------------------------- Detected abilities for source (read only) file system: Access control lists Off Extended attributes Off Windows access control lists On Case sensitivity Off Escape DOS devices Off Escape trailing spaces Off Mac OS X style resource forks Off Mac OS X Finder information Off ----------------------------------------------------------------- POSIX ACLs not supported by filesystem at /media/exthdd1/backup/rdiff-backup-dat a/rdiff-backup.tmp.0 Unable to import win32security module. Windows ACLs not supported by filesystem at /media/exthdd1/backup/rdiff-backup-data/rdiff-bac kup.tmp.0 escape_dos_devices not required by filesystem at /media/exthdd1/backup/rdiff-bac kup-data/rdiff-backup.tmp.0 ----------------------------------------------------------------- Detected abilities for destination (read/write) file system: Ownership changing Off Hard linking On fsync() directories On Directory inc permissions Off High-bit permissions Off Symlink permissions Off Extended filenames On Windows reserved filenames Off Access control lists Off Extended attributes On Windows access control lists Off Case sensitivity On Escape DOS devices Off Escape trailing spaces Off Mac OS X style resource forks Off Mac OS X Finder information Off ----------------------------------------------------------------- Backup: must_escape_dos_devices = 0 Symbolic links excluded by default on Windows Starting mirror C:/Users/Adam/Desktop to /media/exthdd1/backup Processing changed file . Processing changed file Git Shell.lnk Sending back exception [Errno 1] Operation not permitted: '/media/exthdd1/backup /rdiff-backup.tmp.4' of type : E File "/usr/lib/python2.7/dist-packages/rdiff_backup/connection.py", line 335, in answer_requestxception '[Errno 1] Operation not permitted: '/media/exthdd1/b result = apply(eval(request.function_string), argument_list)Traceback (most recent call last):up\Main.pyc", line 304, in error_check_Main File "rdiff_backup\Main.pyc", line 324, in Main File "rdiff-backup", line 30, in n take_action File "/usr/lib/python2.7/dist-packages/rdiff_backup/backup.py", line 232, in p atchle "rdiff_backup\backup.pyc", line 38, in Mirror File "rdiff_backup\Main.pyc", line 304, in error_check_Main ITR(diff.index, diff)ection.pyc", line 370, in reval File "/usr/lib/python2.7/dist-packages/rdiff_backup/rorpiter.py", line 281, in __call__ File "rdiff_backup\Main.pyc", line 324, in Main last_branch.fast_process(*args) File "rdiff_backup\Main.pyc", line 280, in File "/usr/lib/python2.7/dist-packages/rdiff_backup/backup.py", line 529, in f ast_process File "rdiff_backup\Main.pyc", line 346, in Backup if self.patch_to_temp(mirror_rp, diff_rorp, tf): File "/usr/lib/python2.7/dist-packages/rdiff_backup/backup.py", line 559, in p atch_to_temp File "rdiff_backup\connection.pyc", line 450, in __call__ rpath.copy_attribs(diff_rorp, new)OSError0, in reval File "/usr/lib/python2.7/dist-packages/rdiff_backup/rpath.py", line 189, in co py_attribs: rpout.chmod(rpin.getperms())Errno 1] Operation not permitted: '/media/exthdd File "/usr/lib/python2.7/dist-packages/rdiff_backup/rpath.py", line 927, in ch mod self.conn.os.chmod(self.path, permissions & Globals.permission_mask) Fatal Error: Lost connection to the remote system` #Attempts to resolve# - I thought it was permissions but my target directory is 777 - I've tried running CMD as admin - Adding my Windows user account to the user group Users - Got half way through setting up Cygwin to have sshd service but kept getting "Error 1053: Could not start service" so gave up. I tried to do this because I thought SSH aliases would simplify the command and to see if it got me anywhere, something about the placeholder %s makes me feel sick so I thought if I could get around using it then I might get somewhere. Does anyone think SSH aliases is even worth still pursuing?
codaamok (346 rep)
Jul 10, 2015, 12:20 PM • Last activity: Jul 11, 2015, 10:00 AM
1 votes
0 answers
337 views
Backup using rsnapshot not working
I have a server web based Linux and i want to make backup every hour using rsnapshot. this is my rsnapshot file configuration : config_version 1.2 snapshot_root /var/Majjane-Save/ cmd_cp /bin/cp cmd_rm /bin/rm cmd_rsync /usr/bin/rsync cmd_logger /usr/bin/logger cmd_du /usr/bin/du cmd_rsnapshot_diff...
I have a server web based Linux and i want to make backup every hour using rsnapshot. this is my rsnapshot file configuration : config_version 1.2 snapshot_root /var/Majjane-Save/ cmd_cp /bin/cp cmd_rm /bin/rm cmd_rsync /usr/bin/rsync cmd_logger /usr/bin/logger cmd_du /usr/bin/du cmd_rsnapshot_diff /usr/bin/rsnapshot-diff retain hourly 24 verbose 2 loglevel 3 logfile /var/log/rsnapshot.log lockfile /var/run/rsnapshot.pid exclude /var/www/clients/ exclude /var/www/apps/ backup /var/www/ localhost/var/Majjane-Save/ The problem is when i make 3 backups for example : * hourly.0 : the folder backuped has 15 files * hourly.1 : the folder backuped has 14 files ( i removed one file from the folder /var/www/ ) * hourly.2 : the folder backuped has 15 files ( i created an other file different from the first one) when i try to restore the first removed file from my backup hourly.0 i didn't find it, you can say that all of hourly.x folders are just a symbolic links no more.
BAHADDOU Mohammed (13 rep)
May 13, 2015, 08:46 AM • Last activity: May 13, 2015, 09:31 AM
1 votes
1 answers
73 views
Software to do a 3 way backup
I am currently doing a backup of my system on an external hard disk using rdiff-backup. This kind of backup is good when the disk dies. However, I was also wondering if I can extend this method to do a 3 way backup? For example, instead of just backing up to one hard disk, I can back up to two hard...
I am currently doing a backup of my system on an external hard disk using rdiff-backup. This kind of backup is good when the disk dies. However, I was also wondering if I can extend this method to do a 3 way backup? For example, instead of just backing up to one hard disk, I can back up to two hard disks. And everytime, before doing the backup, the program checks for integrity of files by comparing all the three copies, and then chooses the version which agrees on at least two hard disks. This way, I can take care of on disk corruption of my files too. Is it possible with rdiff-backup? If not, does there exist some similar kind of utility?
user12159
Mar 11, 2015, 07:49 AM • Last activity: Mar 11, 2015, 12:12 PM
1 votes
0 answers
178 views
How to free space taken by rdiff-backup data?
I use rdiff-backup for my backups. My disk runs out of space. I would like to clean some rdiff-backup data by removing either: * the backup data of small files with a large number of different versions * the backup data of very large files which have been deleted In order to free space, how to ident...
I use rdiff-backup for my backups. My disk runs out of space. I would like to clean some rdiff-backup data by removing either: * the backup data of small files with a large number of different versions * the backup data of very large files which have been deleted In order to free space, how to identify those files?
Martin Monperrus (1289 rep)
Dec 19, 2013, 10:56 AM • Last activity: Dec 19, 2013, 08:48 PM
2 votes
1 answers
429 views
Is there a FUSE which permits transparently accessing incremental backups?
While _creating_ incremental backups is relatively simple (and can be automated, e.g. via [`rdiff-backup`](http://www.nongnu.org/rdiff-backup/)), in order to access a specific state of a file one first has to manually restore the backup, which is both not-simple and tedious if you need to browse thr...
While _creating_ incremental backups is relatively simple (and can be automated, e.g. via [rdiff-backup](http://www.nongnu.org/rdiff-backup/)) , in order to access a specific state of a file one first has to manually restore the backup, which is both not-simple and tedious if you need to browse through multiple states. So is there a [FUSE](https://en.wikipedia.org/wiki/Filesystem_in_Userspace "filesystem in userspace, so asking for a FUSE filesystem would be redundant") which allows to transparently access previous states e.g. via some filename@2013-01-23 (the backup made at that date, if existing) or filename@{-2} (two backups ago) syntax while the current and backup files reside on arbitrary filesystems (including remote ones, e.g. nfs backups while the current state is on a local ext3)?
Tobias Kienzler (9574 rep)
Jan 23, 2013, 09:27 AM • Last activity: Jan 23, 2013, 09:56 AM
5 votes
1 answers
3161 views
Incremental system backup and restore w/ rsync or rdiff-backup issues
I've been reading about using [rsync][1] and [rdiff-backup][2] to make incremental backups of my entire Linux system. I am planning to practise that by setting up a Linux system, making some changes to it, erasing everything and restoring the system (all with the convenience of doing it in a virtual...
I've been reading about using rsync and rdiff-backup to make incremental backups of my entire Linux system. I am planning to practise that by setting up a Linux system, making some changes to it, erasing everything and restoring the system (all with the convenience of doing it in a virtual machine). But I want to clarify a few things before taking the plunge: 1. How do I get fine control about what gets included in and excluded from the backup? i.e. by default would everything (including invisible "." files, trash, etc.) be backed up? If so, how can I exclude some of them? 2. The rdiff-backup tutorial tells you how to retrieve a file from an arbitrary time in the past (as long as you still have the backup). What if I want to restore the complete system on a new computer? How do I do that? 3. Suppose I make backups of my system on machine A. A few years later I buy a new computer B, and want to restore my system from the backup of machine A. Since the hardware might be totally different, will my new system work when I try to start it up after the restore? How can I ensure a smooth restore onto a new machine? Thanks for your answers.
hpy (4597 rep)
Feb 25, 2011, 10:07 PM • Last activity: Feb 25, 2011, 11:48 PM
Showing page 1 of 19 total questions