Wednesday, June 17, 2026

Priorities

Work Log

Data Warehouse — Enable new tables — DA-1330, DA-1336

This is business-as-usual (BAU) task to enable new tables in the BigQuery. I have done this by registered the tables in the data contract service, re-snapshot the tables, and retry the daily and realtime jobs. As a result, the new tables are now available in the BigQuery.

GitLab to GitHub Migration — Config Manifests — DA-1270

Situation: The company has initiative to migrate Git hosting platform from GitLab to GitHub to reduce the expenses. This Jira task scope is to migrate the config-manifest repository. This repository is very important for the data team, because all of operationals for enabling and maintaining the silver layer tables exist in this repository.

Task: I need to migrate the config-manifest repository, and it's CI/CD pipeline from GitLab to GitHub. This migration is quite challenging because I need to translate the CI/CD pipeline from GitLab CI to GitHub actions. Below is a preview of the pipeline for the master branch:

cicd pipeline

The challenge is that we need to migrate the CD Pipelines below: 1. Deploy the CDC Pipelines 2. Deploy the Daily Pipeline 3. Deploy the Realtime Pipeline 4. Snapshot tables

Action There is no shortcut for this migration because there is so many context such as CI variables, environment, and ets. I found a tool named GitHub Actions Importer, but it does not really help. Therefore, I must carefully translate the CI/CD pipeline from GitLab to GitHub to ensure all functionality is preserved.

Result I am still working on this task.

Blockers

N/A

Carry-overs

Reflection

N/A