book-intro-v1.rst 11 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233
  1. .. _book-intro-v1:
  2. Datalad --- An Introduction to Research Data Management
  3. =======================================================
  4. This page is the online companion to the paperback book
  5. published in 2023, available from a book store near you
  6. (ISBN 979-8857037973), or from any amazon site (e.g.,
  7. `US <https://www.amazon.com/dp/B0CPDB4YMY>`_ or
  8. `EU <https://amzn.eu/d/e6A7nAO>`_).
  9. .. image:: book-intro-v1/intro-v1-cover.jpg
  10. :align: center
  11. :target: ../_images/intro-v1-cover.jpg
  12. The book contains almost 200 references to online resources, and describes a
  13. continuously evolving software ecosystem. In order to maximize the longevity
  14. of the book, this page provides updates to references and content that are no
  15. longer in-sync with the state of the world.
  16. .. _book-intro-v1-urls:
  17. Errata
  18. ------
  19. Presently, there are no known issues in the published book.
  20. If you discovered one, please report it via the `Handbook's issue tracker
  21. <https://github.com/datalad-handbook/book/issues/new/choose>`__. Thank you!
  22. Hyperlink URL index
  23. -------------------
  24. The book's appendix lists URL references to online resources using two or three
  25. character alphanumeric codes. The following lists maps these codes to
  26. an up-to-date URL.
  27. .. container:: book-v1-url-index
  28. :71: https://7-zip.org
  29. :A1: https://apps.apple.com/us/app/xcode/id497799835
  30. :A2: https://aws.amazon.com
  31. :A2A: https://aws.amazon.com/ecr
  32. :A2B: https://aws.amazon.com/s3
  33. :A3: https://www.appveyor.com
  34. :B1: https://git-annex.branchable.com
  35. :B1A: https://git-annex.branchable.com/backends
  36. :B1B: https://git-annex.branchable.com/design/adjusted_branches
  37. :B1C: https://git-annex.branchable.com/git-annex
  38. :B1D: https://git-annex.branchable.com/git-annex-adjust
  39. :B1E: https://git-annex.branchable.com/git-annex-migrate
  40. :B1F: https://git-annex.branchable.com/git-annex-numcopies
  41. :B1G: https://git-annex.branchable.com/git-annex-uninit
  42. :B1H: https://git-annex.branchable.com/git-annex-wanted
  43. :B1K: https://git-annex.branchable.com/install/rpm_standalone
  44. :B1L: https://git-annex.branchable.com/internals/key_format
  45. :B1M: https://git-annex.branchable.com/projects/datalad/bugs-done/Windows__58___substantial_per-file_cost_for___96__add__96__
  46. :B1N: https://git-annex.branchable.com/special_remotes
  47. :B1O: https://git-annex.branchable.com/tips/largefiles
  48. :B1P: https://git-annex.branchable.com/tips/owncloudannex
  49. :B1Q: https://git-annex.branchable.com/tips/using_Amazon_Glacier
  50. :B1R: https://git-annex.branchable.com/tips/using_Google_Cloud_Storage
  51. :B1S: https://git-annex.branchable.com/tips/using_box.com_as_a_special_remote
  52. :B2: https://bitbucket.org
  53. :B3: https://brew.sh
  54. :C1: http://creativecommons.org/publicdomain/zero/1.0
  55. :C2: https://creativecommons.org
  56. :C2A: https://creativecommons.org/licenses/by-sa/4.0
  57. :C2B: https://creativecommons.org/licenses/by/4.0/
  58. :C2C: https://creativecommons.org/public-domain/cc0/
  59. :C3: https://docs.conda.io
  60. :C3A: https://docs.conda.io/miniconda.html
  61. :C3B: https://docs.conda.io/projects/conda/en/latest/user-guide/install/index.html
  62. :D1: https://docs.datalad.org
  63. :D1A: https://docs.datalad.org/en/latest/generated/datalad.config.html
  64. :D1B: https://docs.datalad.org/en/latest/generated/man/datalad-push.html
  65. :D1C: https://docs.datalad.org/en/latest/generated/man/datalad-status.html
  66. :D1D: https://docs.datalad.org/en/latest/modref.html
  67. :D1E: https://docs.datalad.org/projects/container
  68. :D1F: https://docs.datalad.org/projects/gooey
  69. :D1G: https://docs.datalad.org/projects/osf
  70. :D3: https://datasets.datalad.org
  71. :D4: https://datalad.org
  72. :D5: https://docs.docker.com/desktop/install/windows-install/
  73. :D6: https://hub.docker.com
  74. :D7: https://neuro.debian.net
  75. :D7A: https://neuro.debian.net/install_pkg.html?p=datalad
  76. :D7B: https://neuro.debian.net/pkgs/datalad.html
  77. :D8: https://www.debian.org/index.en.html
  78. :D9: https://www.docker.com/get-started
  79. :F1: https://f1000research.com/posters/7-1965
  80. :F2: https://figshare.com
  81. :G1: https://git-scm.com
  82. :G1A: https://git-scm.com/book/en/v2
  83. :G1B: https://git-scm.com/book/en/v2/Customizing-Git-Git-Configuration
  84. :G1C: https://git-scm.com/book/en/v2/Git-Internals-Environment-Variables
  85. :G1D: https://git-scm.com/book/en/v2/Git-Internals-Git-References
  86. :G1E: https://git-scm.com/book/en/v2/Git-Internals-The-Refspec
  87. :G1F: https://git-scm.com/book/en/v2/Git-Tools-Rewriting-History
  88. :G1G: https://git-scm.com/book/en/v2/Git-on-the-Server-Getting-Git-on-a-Server
  89. :G1H: https://git-scm.com/docs/git-cat-file
  90. :G1K: https://git-scm.com/docs/git-config
  91. :G1L: https://git-scm.com/docs/git-config#Documentation/git-config.txt-corefileMode
  92. :G1M: https://git-scm.com/docs/git-push#Documentation/git-push.txt---force
  93. :G1N: https://git-scm.com/docs/git-reflog
  94. :G1O: https://git-scm.com/download/win
  95. :G2: https://github.com
  96. :G2A: https://github.com/ReproNim/neurodocker
  97. :G2B: https://github.com/andrewringler/git-annex-turtle
  98. :G2C: https://github.com/datalad-datasets/bmmr-t1w-250um
  99. :G2D: https://github.com/datalad-datasets/longnow-podcasts
  100. :G2E: https://github.com/datalad-handbook/DataLad-101
  101. :G2F: https://github.com/datalad-handbook/book/issues/new
  102. :G2G: https://github.com/datalad-handbook/midterm_project
  103. :G2H: https://github.com/datalad-handbook/repro-paper-sketch
  104. :G2K: https://github.com/datalad-handbook/resources
  105. :G2L: https://github.com/datalad/datalad-installer
  106. :G2M: https://github.com/myyoda/talk-principles
  107. :G2N: https://github.com/newren/git-filter-repo
  108. :G2O: https://github.com/psychoinformatics-de/studyforrest-data-phase2
  109. :G2P: https://github.com/settings/tokens
  110. :G2Q: https://github.com/swaroopch/byte-of-python/releases/download/vadb91fc6fce27c58e3f931f5861806d3ccd1054c/byte-of-python.pdf
  111. :G3: https://docs.github.com
  112. :G3A: https://docs.github.com/en/authentication/connecting-to-github-with-ssh/generating-a-new-ssh-key-and-adding-it-to-the-ssh-agent
  113. :G3B: https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens
  114. :G3C: https://docs.github.com/en/get-started/getting-started-with-git/about-remote-repositories
  115. :G3D: https://docs.github.com/en/get-started/quickstart/fork-a-repo
  116. :G3E: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/addressing-merge-conflicts/resolving-a-merge-conflict-using-the-command-line
  117. :G3F: https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-large-files-on-github
  118. :G4: https://github.blog/2015-02-06-git-2-3-has-been-released
  119. :G5: https://gin.g-node.org/G-Node/Info/wiki
  120. :G6: https://www.gnu.org
  121. :G6A: https://www.gnu.org/savannah-checkouts/gnu/bash/manual/bash.html#Pattern-Matching
  122. :G6B: https://www.gnu.org/software/sed/manual/sed.html
  123. :G7: https://about.gitea.com
  124. :G8: https://about.gitlab.com
  125. :G9: https://developer.github.com/changes/2020-02-14-deprecating-password-auth
  126. :G10: https://drive.google.com/drive/my-drive
  127. :G11: https://gist.github.com/netj/8836201
  128. :G12: https://gogs.io
  129. :G13: https://jonas.github.io/tig
  130. :G14: https://miykael.github.io/nipype_tutorial/notebooks/introduction_neurodocker.html
  131. :G15: https://raw.githubusercontent.com/datalad/datalad.org/7e8e39b1/content/asciicast/seamless_nested_repos.sh
  132. :G16: https://try.github.io
  133. :G17: https://www.go-fair.org
  134. :G18: https://www.google.com
  135. :H1: https://hochschulcloud.nrw
  136. :H2: https://www.howtogeek.com/42980/the-beginners-guide-to-nano-the-linux-command-line-text-editor
  137. :I1: https://imagemagick.org
  138. :I1A: https://imagemagick.org/index.php
  139. :I1B: https://imagemagick.org/script/download.php
  140. :I2: https://imgflip.com/memesearch?q=cat
  141. :I3: https://ipython.org
  142. :L1: https://singularity.lbl.gov
  143. :L2: https://www.linuxjournal.com/content/globstar-new-bash-globbing-option
  144. :M1: https://learn.microsoft.com
  145. :M1A: https://learn.microsoft.com/en-us/windows/win32/fileio/naming-a-file
  146. :M1B: https://learn.microsoft.com/en-us/windows/wsl/install
  147. :M2: https://mit-license.org
  148. :M3: https://www.monkeyuser.com/2017/step-by-step-debugging
  149. :N1: https://neurostars.org
  150. :N2: https://the-turing-way.netlify.app
  151. :N2A: https://the-turing-way.netlify.app/reproducible-research/renv/renv-containers.html
  152. :N2B: https://the-turing-way.netlify.app/reproducible-research/testing
  153. :O1: https://osf.io
  154. :O2: https://owncloud.com
  155. :O3: https://www.openvim.com
  156. :P1: https://docs.python.org
  157. :P1A: https://docs.python.org/3/library/pdb.html#debugger-commands
  158. :P1B: https://docs.python.org/3/tutorial/classes.html
  159. :P1C: https://docs.python.org/3/tutorial/classes.html#method-objects
  160. :P1D: https://docs.python.org/3/tutorial/venv.html
  161. :P2: https://knowledge-base.psychoinformatics.de
  162. :P2A: https://knowledge-base.psychoinformatics.de/kbi/0003
  163. :P2B: https://knowledge-base.psychoinformatics.de/kbi/0022
  164. :P3: https://pandas.pydata.org
  165. :P4: https://phdcomics.com/comics/archive.php?comicid=1531
  166. :P5: https://pip.pypa.io
  167. :P6: https://pypi.org
  168. :P7: https://seaborn.pydata.org
  169. :P8: https://www.python.org/downloads
  170. :S1: http://scripts.sil.org/OFL
  171. :S2: https://docs.sylabs.io
  172. :S2A: https://docs.sylabs.io/guides/3.4/user-guide/build_a_container.html
  173. :S2B: https://docs.sylabs.io/guides/3.4/user-guide/installation.html
  174. :S3: https://p7zip.sourceforge.net
  175. :S4: https://scikit-learn.org
  176. :S5: https://singularity-hub.org
  177. :S6: https://sourceforge.net/projects/linuxcommand/files/TLCL/19.01/TLCL-19.01.pdf/download
  178. :S7: https://stackoverflow.com/q/2221658/10068927
  179. :S8: https://sylabs.io/docs
  180. :T1: https://tldp.org/LDP/Bash-Beginners-Guide/Bash-Beginners-Guide.pdf
  181. :T2: https://tug.org/fonts/licenses/GUST-FONT-LICENSE.txt
  182. :U1: https://packages.ubuntu.com/datalad
  183. :U2: https://ubuntu.com
  184. :W1: https://en.wikipedia.org
  185. :W1A: `<https://en.wikipedia.org/wiki/Cat_(Unix)>`_
  186. :W1B: https://en.wikipedia.org/wiki/Continuous_integration
  187. :W1C: `<https://en.wikipedia.org/wiki/Docker_(software)>`_
  188. :W1D: https://en.wikipedia.org/wiki/GNOME_Keyring
  189. :W1E: https://en.wikipedia.org/wiki/Group_identifier
  190. :W1F: https://en.wikipedia.org/wiki/Hash_function
  191. :W1G: https://en.wikipedia.org/wiki/Here_document
  192. :W1H: https://en.wikipedia.org/wiki/High-throughput_computing
  193. :W1K: https://en.wikipedia.org/wiki/Iris_flower_data_set
  194. :W1L: `<https://en.wikipedia.org/wiki/Make_(software)>`_
  195. :W1M: https://en.wikipedia.org/wiki/Monorepo
  196. :W1N: https://en.wikipedia.org/wiki/NTFS
  197. :W1O: `<https://en.wikipedia.org/wiki/Pipeline_(Unix)>`_
  198. :W1P: https://en.wikipedia.org/wiki/Recursive_acronym
  199. :W1Q: https://en.wikipedia.org/wiki/Sed
  200. :W1R: `<https://en.wikipedia.org/wiki/Singularity_(software)>`_
  201. :W1S: https://en.wikipedia.org/wiki/Standard_streams
  202. :W1T: `<https://en.wikipedia.org/wiki/Standard_streams#Standard_input_(stdin)>`_
  203. :W1U: `<https://en.wikipedia.org/wiki/Standard_streams#Standard_output_(stdout)>`_
  204. :W1V: https://en.wikipedia.org/wiki/Superuser
  205. :W1W: https://en.wikipedia.org/wiki/Terminal_pager
  206. :W1X: https://en.wikipedia.org/wiki/Windows_Subsystem_for_Linux
  207. :X1: https://xkcd.com
  208. :X1A: https://xkcd.com/1205
  209. :X1B: https://xkcd.com/1722
  210. :X1C: https://xkcd.com/1833
  211. :X1D: https://xkcd.com/2083
  212. :X1E: https://xkcd.com/979
  213. :Z1: https://zenodo.org
  214. Sources
  215. -------
  216. The PDF version of the published book is built from customized LaTeX sources,
  217. originally generated with Sphinx. The sources are available from
  218. https://github.com/datalad-handbook/book-datalad-intro