Data Mart ETL - 2026-05-21
Budgets collection reimport
The Budgets collection has been updated to use the full GLBudgetLine composite key (companyId, branchId, ledgerId, financialYear, groupId, parentGroupId). Sibling budget lines that share a groupId but differ in parentGroupId were previously collapsed under a single document, causing related rows to be lost.
As part of this change, the Budgets collection will be reimported in full. Existing documents will be replaced; no manual action is required from integrators.
The upsert pipeline also no longer filters on Released = 1, so unreleased budget lines are now tracked. This is a prerequisite for the deletion tracking change below.
Deletion tracking and reconciliation enabled for Budgets
Deletion tracking is now available for the Budgets collection. GLBudgetLine deletions in the ERP are picked up via ChangeNotifications and the matching Budget document is soft-deleted (deletedDatabaseRecord = true).
Reconciliation has also been enabled for Budgets: the periodic sweep now matches MongoDB Budget documents against GLBudgetLine rows using the full composite key (BranchID, LedgerID, FinYear, GroupID, ParentGroupID) and soft-deletes any orphaned documents missed by the notification pipeline.