Skip to main content

Data Mart ETL - Release Notes

Date: 2026-05-21

Budgets collection reimport - VNEDM-1948​

The Budgets collection has been updated to use the full GLBudgetLine composite key (companyId, branchId, ledgerId, financialYear, groupId, parentGroupId). Sibling budget lines that share a groupId but differ in parentGroupId were previously collapsed under a single document, causing related rows to be lost.

As part of this change, the Budgets collection will be reimported in full. Existing documents will be replaced; no manual action is required from integrators.

The upsert pipeline also no longer filters on Released = 1, so unreleased budget lines are now tracked. This is a prerequisite for the deletion tracking change below.

Deletion tracking and reconciliation enabled for Budgets - VNEDM-1948​

Deletion tracking is now available for the Budgets collection. GLBudgetLine deletions in the ERP are picked up via ChangeNotifications and the matching Budget document is soft-deleted (deletedDatabaseRecord = true).

Reconciliation has also been enabled for Budgets: the periodic sweep now matches MongoDB Budget documents against GLBudgetLine rows using the full composite key (BranchID, LedgerID, FinYear, GroupID, ParentGroupID) and soft-deletes any orphaned documents missed by the notification pipeline.