Uploading Data

These instructions will guide you on how to upload data to EMBER-DANDI.

Prerequisites

Please ensure that your data is formatted using NWB and BIDS before attempting to upload to EMBER-DANDI

My files are in a mix of standards or I have not used standards

Please contact the EMBER team at help@emberarchive.org to facilitate data ingestion into EMBER-DANDI. We are also happy to add you to our Slack workspace.

Below, we have provided one set of instructions for users that are new to EMBER-DANDI, and one set for experienced users. Please follow whichever best fits your needs:

1. I've used DANDI or CLI tools before
2. I'm new to Python, CLI, and/or DANDI
   • Learn how to set up Python, install the DANDI Client, and use NWB

---

Instructions for Experienced Users

The following is a quick reference of the steps for uploading data using the DANDI Client:

dandi download https://dandi.emberarchive.org/dandiset/<dandiset_id>/draft
cd <dandiset_id>
dandi organize <source_folder> -f dry
dandi organize <source_folder>
dandi validate .
dandi upload -i ember-dandi

---

Instructions for New Users

Install Python and the DANDI Client

Please refer to our Dandi Client page.

Register for an EMBER-DANDI Account

The steps for registering for an EMBER-DANDI account can found on our Getting Started page.

Getting Started with NWB

For the latest information on NWB (Neurodata Without Borders), we recommend referring to their documentation at nwb.org!

Below, you will find a brief set of steps to help you quickly get started with NWB.

1. We recommended installing the NWB Guide, a desktop application that converts common neuroscience data formats into NWB to enable uploading to EMBER-DANDI.
2. Complete key tutorials for NWB GUIDE:
   • Generate a dataset
   • Convert a single session of data
   • Convert a multi-session of data
3. Repeat steps with your own your data
   • Important Note: All data formats are not currently supported! Ensure your data is supported by checking the ecosystem compatibility

Create an EMBER-DANDI dandiset

1. Log in to EMBER-DANDI with your approved GitHub account
2. Select the "New Dandiset" button in the top right corner
3. Fill out basic metadata and hit "Register Dandiset"

Upload data to your dandiset

1. Validate your converted files, replacing <source_folder> with the path to your .nwb files:

   dandi validate --ignore DANDI.NO_DANDISET_FOUND <source_folder>
   

2. Navigate to your dandiset on EMBER-DANDI and copy the dandiset ID number

1. Upload your validated .nwb files using the following commands, replacing <dandiset_id> and <source_folder> with your specific information:

   dandi download https://dandi.emberarchive.org/dandiset/<dandiset_id>/draft
   cd <dandiset_id>
   dandi organize <source_folder> -f dry
   dandi organize <source_folder>
   dandi validate .
   dandi upload -i ember-dandi
   

Uploading Video Files

If using video files, replace dandi organize "source folder" with dandi organize --update-external-file-paths --files-mode copy /path/to/source_folder

Password Prompt

If this is your first upload, you may get a prompt to enter a password. In the EMBER-DANDI Portal, click on your user icon in the top right to retrieve your API key. Enter this when prompted for your password.