Discovery to Enterprise Data Export

Table of Contents

1. Introduction
2. Overview
3. Instruction Steps
   • Data Export Container Setup
   • Data Export
   • Monitoring Data Export
4. Resources
5. FAQs

Introduction

This document will provide the export process steps to transfer data from Discovery to Enterprise. Once data has been populated into the desired project on Discovery, it can be exported to Enterprise by launching a container on Discovery which will export the data to Enterprise. Additionally, this document will cover all parts of the data export workflow, including setting up the export container and monitoring the export process.

Overview

This document contains details of the following:

1. Data Export Container Setup: Describes how to enable an export container on a Project in Discovery
2. Exporting Data: Describes how to set up either (i.) an event service to tigger data export or (ii) perform batch launch of export jobs to begin the data transfer process
3. Monitoring Data Export: Describes how to monitor the data transfer process to Enterprise

Instructions for Setup

These Instructions for setup will walk the user through three simple steps involved in exporting data from Discovery to Enterprise. The steps involved can be performed to send data from a Discovery system that has been pre-configured for data export to an Enterprise system. Flywheel support will set this up for you at the outset.

Data Export Container Setup

This section describes how to enable the export container on a Project in Discovery. You may have created this project in Discovery Admin prior to pulling and linking your requested data via the Discovery Control Panel. 

The workflow assumes that the appropriate Group and Project(s) have been pre-created on Enterprise, any required de-identification profiles as well as any required gears that you wish to run on the data incoming into Enterprise have already been set up. Neglecting to address these requirements may result in failed exports.

 

Once the project is created, navigate to your project on Discovery Admin, and follow the steps below to set up the export container. From the Project Landing Page on Discovery Admin, select Project Settings from the Actions Menu on the right side.

 

 

Now Toggle the button to enable the Export Session Data from  FW Discovery-XNAT to FW Enterprise container.

 

 

Note: One will need to perform the steps above once for any new Project that is created on Discovery-Admin prior to being able to send data to Enterprise from that project.

 

Exporting Data 

Depending on your particular use case , there are a couple of different paths you could take to export data to Enterprise.

1. Data is de-identified on Enterprise thus requiring a De-ID profile setup and additional validation steps prior to data export. If this is your workflow, then you may want to skip to the Batch Launch Export Container section below.

2. Data is being exported to Enterprise without applying any de-Identification on Enterprise. If this is your preferred workflow, you should skip to the Setup Event Service to Export Data section below.

 

Batch Launch Export Container

If your workflow requires sending a small batch of N sessions initially to Enterprise as a way to establish and validate a De-Identification profile that has been setup on your Enterprise project, then you can accomplish this by using the Batch Launch workflow described below.

Once the export container is enabled for the project, hover your cursor over Processing Dashboard in the Actions menu and select a Session type (for ex, say MR Sessions) to navigate to the Batch Launch Page.

 

 

From the Batch Launch Processing Page, select export_data_disc2ent from the dropdown menu.

 

 

Select "N" number of sessions to test and validate your De-ID profile on Enterprise by checking the checkbox next to N number of sessions (10 sessions should suffice in most cases), then click the Launch job menu button.

 

 

In the Container Launch Menu, set the Project-Id and Group-Id fields as per the destination project and group IDs on Enterprise and click Run Container(s) to begin the Data Export.

 

 

Once you've established a satisfactory De-ID profile on Enterprise , you can use the Batch Launch feature to filter and select the remaining sessions to export to Enterprise.

 

TIP:  For example, sessions that are ready to be sent can be filtered using the 'Ready' keyword, followed by then selecting all the filtered sessions using the 'Toggle all' checkbox as shown below.

 

 

TIP : Sessions already exported to Enterprise will show up as 'Complete'. If any failures occur, those sessions can be selected by filtering using the 'Failed' keyword and re-exported.

 

TIP: Repeat the Batch Launch Process above for the other Session modalities as required (MR, CT, US etc.)

 

Setup Event Service to Export Data 

If your workflow requires that data being exported to Enterprise need not be de-identified on Enterprise, then you can avail the Discovery Admin's Event Service feature to automatically route data to Enterprise when doing a data request.

 

Once you've set up your project and enabled the export container as described in the section titled

Data Export Container Setup, you can navigate to the Administer - > Event Service setup page. Under Event Subscriptions, click on Add New Event Subscription and set up as per your requirements. Below is an example of an event service that will automatically launch and run the export_data_disc2ent container on any sessions that are sent to the BANDWIDTH3 project. Additionally it also has Enterprise routing attributes set up to route to the appropriate group-id and project-id on Enterprise.

 

 

Once the above Event Subscription rule is setup and enabled, any data requested and pulled into the BANDWIDTH3 project (in this example), will be automatically sent to Enterprise!

 

TIP: If you want to auto-export to work as mentioned above, you would need to set up the event subscription rule prior to submitting you data request via the Discovery Control Panel!

 

Monitoring Data Export 

This section demonstrates how to monitor the Export Process as data is transferred from Discovery to Enterprise. One can monitor the progress of the export process via the User Dashboard table on Discovery-Admin.

 

FAQs