Skip to content

Data & Process Management

Funding

  • Getty Institute

Duration

On-going since May 2022

Links

Problem

Transform the entire STARDATA dataset and load it to Arches.
Support and develop the ETL code accordingly.

Activities

  • Support new developments after the following triggers
    1. model change
    2. new raw-field modeled
    3. generic bug fix
    4. static data changes
  • Detailed Reporting using JIRA
  • ETL workflow updating
  • Support Loading and Querying on Arches
  • Data Normalization & Transformation

Goals

  • Develop an Efficient and User Friendly ETL Workflow.

Achievements

  • We are getting there.