The ingest folder command should be used if you are importing data that you previously downloaded from Flywheel, or if you are importing data that was shared from another Flywheel site. The folder import command uses the folder structure to map your data to the Flywheel hierarchy. Learn how to run the ingest folder command.
Below is the basic Flywheel hierarchy:
Beta feature
CLI Bulk Ingest is currently in beta. This feature is designed to improve performance and stability when importing large volumes of historical data. CLI Bulk Ingest requires an upgrade to our new V3 infrastructure, which we will begin deploying to sites starting in April 2020.
We do not recommend using Bulk Ingest until your site is upgraded to V3 because this infrastructure change is required to the improved upload performance. If your site is on V2 infrastructure, continue to use the import command to upload historical data. Contact your site admin to see which version your site is on.
|
Required argument |
Description |
|---|---|
|
SRC |
The parent folder for the directory you want to import |
Tip
If you are using multiple optional arguments in your command, consider creating a config file. See our article for more information on creating and using a config file.
|
Optional arguments |
Description |
|---|---|
|
-h, --help |
show this help message and exit |
|
-C PATH, --config-file PATH |
Specify configuration options via config file. Learn how to create this config file. (default: ~/.config/flywheel/cli.yml) |
|
--no-config |
Do NOT load the default configuration file (default: False) |
|
--ca-certs CA_CERTS |
The file to use for SSL Certificate Validation (default: None) |
|
-timezone TIMEZONE |
Set the effective local timezone for imports (default: None) |
|
--quiet |
Squelch log messages to the console(default: False) |
|
--debug |
Turn on debug logging (default: False) |
|
-v, --verbose |
Get more detailed output (default:False) |
|
-y, --yes |
Assume the answer is yes to all prompts (default:False) |
|
--no-subjects |
No subject level (create a subject for every session) (default: False) |
|
--no-sessions |
No session level (create a session for every subject) (default: False) |
|
--symlinks |
Follow symbolic links that resolve to directories (default: False) |
|
--include-dirs PATTERN |
Patterns of directories to include (default: []) NoteWhen S3 bucket is configured as source, this flag does not support regex wildcard match, only “starts with.”
|
|
--exclude-dirs PATTERN |
Patterns of directories to exclude (default: []) |
|
--include PATTERN |
Patterns of filenames to include (default: []) |
|
--exclude PATTERN |
Patterns of filenames to exclude (default: []) |
|
--compression-level COMPRESSION_LEVEL |
The compression level to use for packfiles -1 by default. 0 for store. A higher compression level number means more compression |
|
--ignore-unknown-tags |
Ignore unknown dicom tags when parsing dicom files (default: False) |
|
--encodings ENCODINGS |
Set character encoding aliases. E.g. win_1251=cp1251 (default: []) |
|
--de-identify |
De-identify DICOM files (default: False) |
|
--deid-profile NAME |
Use the De-identify profile by name (default: minimal) |
|
--skip-existing |
Skip import of existing files (default: False) |
|
--no-audit-log |
Skip uploading audit log to the target projects (default: False) |
|
--load-subjects PATH |
Load subjects from the specified file (default: None) |
|
--db-check-fn DB_CHECK_FN |
Optional database schema check function (default: None) |
|
-g ID, --group ID |
The id of the group, if not in folder structure (default: None) |
|
-p LABEL, --project LABEL |
The label of the project, if not in folder structure (default: None) |
|
--dicom NAME |
The name of dicom subfolders to be zipped prior to upload (default: dicom) |
|
--pack-acquisitions TYPE |
Acquisition folders only contain acquisitions of type and are zipped prior to upload (default: None) |
|
--root-dirs ROOT_DIRS |
The number of directories to discard before matching |
These config options are only available when using cluster mode with the “--follow” argument or when using local worker.
|
Optional argument |
Description |
|---|---|
|
--save-audit-log PATH |
Save audit log to the specified path on the current machine (default: None) |
|
--save-deid-log PATH |
Save de-id log to the specified path on the current machine (default: None) |
|
--save-subjects PATH--save-subjects PATH |
Save subjects to the specified file (default: None) |
These config options are only available when using local worker (--cluster is not defined)
|
Optional argument |
Description |
|---|---|
|
--jobs JOBS |
The number of concurrent jobs to run (e.g. scan jobs), ignored when using cluster (default: 4) |
|
--sleep-time SECONDS |
Number of seconds to wait before trying to get a task (default: 1) |
|
--max-tempfile MAX_TEMPFILE |
The max in-memory tempfile size, in MB, or 0 to always use disk (default: 50)The max in-memory tempfile size, in MB, or 0 to always use disk (default: 50) |