lukechilds
/
duplicati.github.io
mirror of https://github.com/lukechilds/duplicati.github.io.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Browse Source

Spacing ...

master
Kenneth Skovhede 8 years ago
parent
18fd6e9680
commit
ac861d61f9
1 changed files with 64 additions and 64 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Unified View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 128
      _posts/articles/2016-10-14-Backup-Process.md

128
_posts/articles/2016-10-14-Backup-Process.md
View File

@ -74,8 +74,8 @@ When Duplicati recieves the first entry, `C:\data\`, it notices that the entry i
```json ```json
[ [
{ {
"type": "folder", "type": "folder",
"path": "C:\\data\\" "path": "C:\\data\\"
} }
] ]
``` ```
@ -98,17 +98,17 @@ qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4= (4kb)
The file is then added to `filelist.json`, which now looks like this: The file is then added to `filelist.json`, which now looks like this:
``` ```json
[ [
{ {
"type": "Folder", "type": "Folder",
"path": "C:\\data\\" "path": "C:\\data\\"
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\mydoc.txt", "path": "C:\\data\\mydoc.txt",
"size": 4096, "size": 4096,
"hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4=" "hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4="
} }
] ]
``` ```
@ -130,7 +130,7 @@ Additionally, a file hash is computed, but unlike a small file, the file hash is
We could choose to store these values directly in `filelist.json`, for example: We could choose to store these values directly in `filelist.json`, for example:
``` ```json
{ {
"type": "File", "type": "File",
"path": "C:\\data\\myvideo.mp4", "path": "C:\\data\\myvideo.mp4",
@ -162,24 +162,24 @@ Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA= (96b)
The new file entry is then stored in filelist, which then looks like: The new file entry is then stored in filelist, which then looks like:
``` ```json
[ [
{ {
"type": "Folder", "type": "Folder",
"path": "C:\\data\\" "path": "C:\\data\\"
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\mydoc.txt", "path": "C:\\data\\mydoc.txt",
"size": 4096, "size": 4096,
"hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4=" "hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4="
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\myvideo.mp4", "path": "C:\\data\\myvideo.mp4",
"size": 215040, "size": 215040,
"hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=", "hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=",
"blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ] "blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ]
} }
] ]
``` ```
@ -208,34 +208,34 @@ We chose to omit this part based on a number of observations:
This means that an additional entry for `C:\data\extra\olddoc.tx` will occur in `filelist.json`: This means that an additional entry for `C:\data\extra\olddoc.tx` will occur in `filelist.json`:
``` ```json
[ [
{ {
"type": "Folder", "type": "Folder",
"path": "C:\\data\\" "path": "C:\\data\\"
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\mydoc.txt", "path": "C:\\data\\mydoc.txt",
"size": 4096, "size": 4096,
"hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4=" "hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4="
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\myvideo.mp4", "path": "C:\\data\\myvideo.mp4",
"size": 215040, "size": 215040,
"hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=", "hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=",
"blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ] "blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ]
}, },
{ {
"type": "Folder", "type": "Folder",
"path": "C:\\data\\extra" "path": "C:\\data\\extra"
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\extra\\olddoc.txt", "path": "C:\\data\\extra\\olddoc.txt",
"size": 2048, "size": 2048,
"hash": "R/XSNsb4ln/SkeJwFDd4Fv4OnW2QNIxMR4HItgg9qCE=" "hash": "R/XSNsb4ln/SkeJwFDd4Fv4OnW2QNIxMR4HItgg9qCE="
} }
] ]
``` ```
@ -247,41 +247,41 @@ This approach is also known as [deduplication](https://en.wikipedia.org/wiki/Dat
The final contents of `filelist.json` is then: The final contents of `filelist.json` is then:
``` ```json
[ [
{ {
"type": "Folder", "type": "Folder",
"path": "C:\\data\\" "path": "C:\\data\\"
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\mydoc.txt", "path": "C:\\data\\mydoc.txt",
"size": 4096, "size": 4096,
"hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4=" "hash": "qaFXpxVTuYCuibb9P41VSeVn4pIaK8o3jUpJKqI4VF4="
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\myvideo.mp4", "path": "C:\\data\\myvideo.mp4",
"size": 215040, "size": 215040,
"hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=", "hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=",
"blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ] "blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ]
}, },
{ {
"type": "Folder", "type": "Folder",
"path": "C:\\data\\extra" "path": "C:\\data\\extra"
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\extra\\olddoc.txt", "path": "C:\\data\\extra\\olddoc.txt",
"size": 2048, "size": 2048,
"hash": "R/XSNsb4ln/SkeJwFDd4Fv4OnW2QNIxMR4HItgg9qCE=" "hash": "R/XSNsb4ln/SkeJwFDd4Fv4OnW2QNIxMR4HItgg9qCE="
}, },
{ {
"type": "File", "type": "File",
"path": "C:\\data\\extra\\samevideo.mp4", "path": "C:\\data\\extra\\samevideo.mp4",
"size": 215040, "size": 215040,
"hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=", "hash": "4sGwVN/QuWHD+yVI10qgYa4e2F5M4zXLKBQaf1rtTCs=",
"blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ] "blocklists": [ "Uo1f4rVjNRX10HkxQxXauCrRv0wJOvStqt9gaUT0uPA=" ]
}, },
] ]
``` ```
@ -306,4 +306,4 @@ Many details were omitted from the above example run, some of those details can
- A local database is used to keep track of hashes and files - A local database is used to keep track of hashes and files
- A `dindex` file is created to keep track of which `dblock` files have each hash - A `dindex` file is created to keep track of which `dblock` files have each hash
Some more details can be found in the whitepaper [A block-based storage model for remote online backups in a trust-no-one environment)](/assets/Block-basedstorageformat.pdf). Even more details in the [Duplicati source code](https://github.com/duplicati/duplicati). Some more details can be found in the whitepaper [A block-based storage model for remote online backups in a trust-no-one environment)](/assets/Block-basedstorageformat.pdf). Even more details in the [Duplicati source code](https://github.com/duplicati/duplicati).
Write Preview
Loading…
Cancel
Save