wiki:DataIntegrations

Version 16 (modified by Richard Bramley, 9 years ago) ( diff )

--

DataIntegrations

Error: Macro BackLinks(DataIntegrationSource) failed
'Environment' object has no attribute 'get_db_cnx'

Error: Macro BackLinks(DataIntegrationDestination) failed
'Environment' object has no attribute 'get_db_cnx'

Error: Macro BackLinks(DataIntegrationCategory) failed
'Environment' object has no attribute 'get_db_cnx'

Error: Macro BackLinks(DataIntegrationJob) failed
'Environment' object has no attribute 'get_db_cnx'

A List of them all

Onyx

Leicester BRICCS Study

Data Collection: Nearly Complete

No new patients are being entered into Onyx at Leicester. However, there are still some patients whose data is not yet complete, as they have not had their medical notes checked.

i2b2 Extract

  • Status: Working
  • Improvements Required: Needs replacing
  • Source: Onyx
  • Destination: i2b2
  • Technology: i2b2 Onyx Importer
  • Description: This requires the Next Patient Number.

CiviCRM Import

  • Status: Deprecated when data collection complete
  • Source: Onyx
  • Destination: CiviCRM
  • Technology: Drupal Cron Job
  • Description: Pulls data out of Onyx database and creates a patient record and BRICCS Study enrolment in CiviCRM.

CiviCRM Extract

  • Status: Not yet written
  • Source: CiviCRM
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Pulls data out of Onyx database and creates a patient record and BRICCS Study enrolment in CiviCRM.

Northampton BRICCS Study

Data Collection: Ongoing

New patients continue to be entered into Onyx at Northampton.

i2b2 Extract

  • Status: Working
  • Improvements Required: Needs replacing
  • Source: Onyx
  • Destination: i2b2
  • Technology: Drupal Cron Job
  • Description: This requires the Next Patient Number.

CiviCRM Extract

  • Status: Not Required

Test BRICCS Study

Data Collection: Complete

i2b2 Extract

  • Status: Working
  • Improvements Required: Needs replacing
  • Source: Onyx
  • Destination: i2b2
  • Technology: i2b2 Onyx Importer
  • Description: This requires the Next Patient Number.

i2b2 Extract (Version 2)

  • Status: Working
  • Improvements Required: Needs replacing
  • Source: Onyx
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description:

REDCap

SCAD Study (university Internet server)

Data Collection: Ongoing

Participants still register for the SCAD Study and existing participants continue to complete additional questionnaires.

CiviCRM Extract

  • Status: Working
  • Improvements Required: OK for now
  • Source: REDCap
  • Destination: CiviCRM
  • Technology: Manual
  • Description: Spreadsheets are downloaded from REDCap and loaded into CiviCRM.

BRICCS Study Leicester (hospital internal server)

Data Collection: Ongoing

CiviCRM Extract

  • Status: Required
  • Improvements Required:
  • Source: REDCap
  • Destination: CiviCRM
  • Technology: Drupal cron job
  • Description: Load status of REDCap questionnaire into CiviCRM BRICCS Study enrolment.

i2b2 Extract

  • Status: Completed
  • Improvements Required:
    • Add more fields as needs arise
    • No interview date, so no start date for observations
  • Source: REDCap
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Load questionnaire data into i2b2.

BRICCS Study External Sites (hospital N3 server)

Sites

  • Kettering: recruiting
  • Doncaster: recruiting
  • Sheffield: recruiting
  • Lincoln: recruiting
  • Grantham: recruiting
  • Chesterfield: recruiting
  • Northampton: planned
  • Royal Free Hospital: planned (might be DREAM Study)

CiviCRM Extract

  • Status: Not Required

i2b2 Extract

  • Status: Completed
  • Improvements Required:
    • Add more fields as needs arise
    • No interview date, so no start date for observations
  • Source: REDCap
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Load questionnaire data into i2b2.

CiviCRM

Common

HSCIC Practice Import

  • Status: Working
  • Improvements Required: None
  • Source: HSCIC practice details files
  • Destination: CiviCRM practice details
  • Technology: Drupal cron job

GENVASC Study

Data Collection: Ongoing

Recruitment ongoing. Will need to be able to continue amending participants records after recruitment is complete to track withdrawals.

ICE Message Import

  • Status: Working
  • Improvements Required: Amend the processing of ICE messages to require fewer manual amendments by the administrators.
  • Source: Server: UHLSQLPRIME01\UHLBRICCSDB Database: genvasc-ice
  • Destination: CiviCRM
  • Technology: PHP MS SQL Server connection

i2b2 Extract Available Patients

  • Status: Working
  • Improvements Required: None
  • Source: CiviCRM
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Load participant and consent information.

i2b2 Delete Withdrawn Patients

  • Status: Working
  • Improvements Required: None
  • Source: CiviCRM
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Delete participants who have withdrawn.
Improvements Required

Check that it also deletes excluded participants.

BRICCS Study

Data Collection: Ongoing

Recruitment ongoing. Will need to be able to continue amending participants records after recruitment is complete to track withdrawals.

i2b2 Delete Withdrawn Patients

  • Status: Required
  • Improvements Required: None
  • Source: CiviCRM
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Delete participants who have withdrawn.

NIHR Bio-Resource

Data Collection: Ongoing

Recruitment ongoing. Will need to be able to continue amending participants records after recruitment is complete to track withdrawals.

i2b2 Extract Available Patients

  • Status: Working
  • Improvements Required: None
  • Source: CiviCRM
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Load participant and consent information.

i2b2 Delete Withdrawn Patients

  • Status: Required
  • Improvements Required: None
  • Source: CiviCRM
  • Destination: i2b2
  • Technology: i2b2 Mapped Importer
  • Description: Delete participants who have withdrawn.

CaTissue

GENVASC Study

Data Collection: Ongoing

Participant Reconciliation

  • Status: Required
  • Improvements Required: None
  • Source: CiviCRM & CaTissue
  • Destination: Report
  • Technology: Drupal cron job?
  • Description: Reconcile the GPt numbers in CaTissue with those in CiviCRM to check that all samples have enrolments and all enrolments have samples.

BRICCS Study

Data Collection: Ongoing

Participant Reconciliation

  • Status: Required
  • Improvements Required: None
  • Source: CiviCRM & CaTissue
  • Destination: Report
  • Technology: Drupal cron job?
  • Description: Reconcile the BPt numbers in CaTissue with those in CiviCRM to check that all samples have enrolments and all enrolments have samples.

i2b2

GENVASC Study

Data Collection: Ongoing

GEM Primary Care Data

  • Status: Particially Written
  • Improvements Required: Need meeting with GEM
  • Source: GEM SystemOne and EMIS data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import primary care data from GEM

PATS Data

  • Status: Working
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital audit data

PMI Data

  • Status: Working
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital PMI data

Hospital HES Data

  • Status: Partially Written
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital HES data

Hospital Discharge Letters Data

  • Status: Partially Written
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital discharge data

National HES Data

  • Status: Required
  • Improvements Required: None
  • Source: HSCIC DARS
  • Destination: i2b2
  • Technology: ?
  • Description: Import national HES data

National ONS Cause of Death Data

  • Status: Required
  • Improvements Required: None
  • Source: HSCIC DARS
  • Destination: i2b2
  • Technology: ?
  • Description: Import national ONS Cause of Death data

BRICCS Study

Data Collection: Ongoing

PATS Data

  • Status: Working
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital audit data

PMI Data

  • Status: Working
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital PMI data

Hospital HES Data

  • Status: Partially Written
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital HES data

Hospital Discharge Letters Data

  • Status: Partially Written
  • Improvements Required: None
  • Source: UHL data warehouses
  • Destination: i2b2
  • Technology: SSIS
  • Description: Import hospital discharge data

Error: Macro BackLinks(None) failed
'Environment' object has no attribute 'get_db_cnx'

Note: See TracWiki for help on using the wiki.