Reliability/Validity measures

Lucas Gautheron 1cdef692c9 SM with recalc 9 tháng trước cách đây
CODE 1cdef692c9 SM with recalc 9 tháng trước cách đây
OUTPUT 4ce629128c more bug fixes but still need to double check all numbers 11 tháng trước cách đây
data_output 4e867be9fb knits but have not finished checking accuracy of numbers (did some bug fixes in var names) 11 tháng trước cách đây
input aa4c76f402 SM updated to facilitate reading 11 tháng trước cách đây
.gitignore 04d7c7f6be Added corpus description table 1 năm trước cách đây
.gitmodules b029652dd8 major renaming and cleaning 1 năm trước cách đây
README.md e3e645dc7c list fix 9 tháng trước cách đây
SM.pdf d7c9b311f1 compilation fix and additional instructions 9 tháng trước cách đây
SM_recalc.pdf 1cdef692c9 SM with recalc 9 tháng trước cách đây
to-download-zip.jpg 0dbd29c9f6 added repro instructions 9 tháng trước cách đây

README.md

Establishing the reliability of measures extracted from long-form recordings using LENA and the ACLEW pipeline

This repository contains the data and the code necessary to reproduce the results of the paper "Establishing the reliability of measures extracted from long-form recordings using LENA and the ACLEW pipeline".

Structure

This repository is structured as follows :

  • CODE: contains the code necessary to preprocess the and to replicate the analysis in the paper
  • data_output: contains the data which is used for the analyses in the paper
  • OUTPUT: contains the derived data (ICCs) computed by the script all-analyses.R using the data found in DATA
  • input: contains the data sets which are used in this paper. Access to the data sets is only necessary to replicate the content of DATA (i.e. compilation of whole the metrics, children age, etc.). If you are not a LAAC member of trusted member, you cannot have access to this data. For more information, contact Alejandrina Cristia.

Reproducing the paper analyses

Some readers may want to check our materials for reproducibility. To regenerate our supplementary materials, you will need RStudio. For further information on using Rmd for transparent (knittable) analyses, see Mike Frank & Chris Hartgerink's tutorial.

If you simply want to check the reproducibility of the paper analyses, you can download a zipped version from our GIN repo, by clicking on the button that looks like a downward pointing arrow, near the top right of the page (under Publications; see to-download-zip.jpg).

  1. Unzip the downloaded zip folder.
  2. Double click on the CODE folder, and on SM.Rmd to launch RStudio with the correct working directory (or if RStudio is already running, change working directory into the unzipped folder)
  3. Click on the "knit" button near the top of the RStudio window
  4. If anything fails, the most likely issue will be that you are missing a library. For most of the packages, you can install the package through the GUI menu or by typing in the commands section (near the bottom of the RStudio window) install.package("LIBRARYNAME") (replace LIBRARYNAME with the package that the system said was not found). If the package missing is papaja, please follow instructions here. Dependencies can be quickly installed by issuing the following command in Rstudio:
list.of.packages <- c("lme4","performance","ggplot2","ggthemes","ggpubr","kableExtra","psych","dplyr","tidyr","stringr","car","ggbeeswarm")
new.packages <- list.of.packages[!(list.of.packages %in% installed.packages()[,"Package"])]
if(length(new.packages)) install.packages(new.packages)

If anything looks different, please double-check that you are using the same versions of all packages by looking at the capture of the environment at the very end of the .pdf file

It is also possible to generate the supplementary materials from the command line (without opening Rstudio) in a single instruction:

Rscript -e 'library(rmarkdown); rmarkdown::render("CODE/SM.Rmd", "pdf_document", output_file = "SM.pdf")'

Raw Data Access

Raw data access is NOT necessary for you to reproduce the supplementary analyses, and thus the numbers and figures in the manuscript. At present, the raw data is only accessible with additional ethics and security approval.

Re-using the dataset

Requirements

You will first need to install the ChildProject package for Python (optional) as well as DataLad. Instructions to install these packages can be found here.

Configuring your SSH key on GIN

This step should only be done once:

  1. Create an account on (GIN)[https://gin.g-node.org/] if you don't have one already

  2. Copy your SSH public key to your clipboard (usually located in ~/.ssh/id_rsa.pub). If you don't have one, please create one following these instructions

  3. In your browser, go to GIN > Your parameters > SSH keys

  4. Click on the blue "Add a key" button, then paste the content of your public key in the Content field, and submit

Your key should now appear in your list of SSH keys - you can add as many as necessary.

Installing the dataset

The next step is to clone the dataset :

datalad install -r git@gin.g-node.org:/LAAC-LSCP/RELIVAL.git
cd RELIVAL

Getting data

You can get data from a dataset using the datalad get command, e.g.:

datalad get CODE/* # download scripts
datalad get DATA/* # download data

Or:

datalad get . # get everything

You can download many files in parallel using the -J or --jobs parameters:

datalad get . -J 4 # get everything, with 4 parallel transfers

For more help with using DataLad, please refer to our cheatsheet or DataLad's own cheatsheet. If this is not enough, check DataLad's documentation and Handbook.

Fetching updates

If you are notified of changes to the data, please retrieve them by issuing the following commands:

datalad update --merge
datalad get .

Removing the data

It is important that you delete the data once your project is complete. This can be done with datalad remove:

datalad remove -r path/to/your/dataset