Central Data Repository City of Sugar Land, Office of Data and Innovation
PRODUCTION
Kevin Tran, Data Engineer (Data Engineer)
View as Administrator Data engineer Utilities steward Police steward
Pipeline runs / R-20261107-0200   Previous run   Next run

Run R-20261107-0200 Succeeded

Nightly in Production, scheduled 11/07/2026 02:00, finished 11/07/2026 02:13.
Rows extracted2,991
Rows quarantined0
Rows released115
Alerts opened / resolved0 / 4
Reconciliation: Within tolerance168 metric months
Changes since the previous run.
11/06/2026 07:52 Kevin Tran: Acknowledged schema drift alert on EnerGov permits. (CDR-2291)
11/06/2026 09:42 Kevin Tran: Published source mapping v4 (IssueDate) for EnerGov permits and scheduled a replay from the 11/05 02:00 watermark. (CDR-2291)

Alerts opened in this run

No alerts opened.

Alerts resolved in this run

High Schema change detected in EnerGov permits
A-1043, opened by R-20261106-0200, resolved 11/07/2026 02:11
High EnerGov permits: 115 records held by DQ-101
A-1044, opened by R-20261106-0200, resolved 11/07/2026 02:11
High DS-01 does not reconcile with the legacy performance database
A-1045, opened by R-20261106-0200, resolved 11/07/2026 02:11
High DS-02 does not reconcile with the legacy performance database
A-1046, opened by R-20261106-0200, resolved 11/07/2026 02:11

Quarantine

DatasetRuleHeld in this runReleased in this run
PermitsDQ-101115

Steps

#StepDatasetConnectorMethodRowsSecondsStatusDetail
1ExtractAccounts payable invoicesTyler MunisCDC 685.8SucceededWindow 11/06 02:00 to 11/07 02:00.
2ExtractUtility billsTyler MunisCDC 1,4379.0SucceededWindow 11/06 02:00 to 11/07 02:00.
3ExtractPermitsEnerGovAPI incremental 1564.2SucceededReplay from the 11/05 02:00 watermark after mapping v4. Window 11/05 02:00 to 11/07 02:00.
4ExtractInspectionsEnerGovAPI incremental 345.7SucceededWindow 11/06 02:00 to 11/07 02:00.
5ExtractCode enforcement casesEnerGovAPI incremental 77.4SucceededWindow 11/06 02:00 to 11/07 02:00.
6ExtractWork ordersCityworksAPI incremental 754.1SucceededWindow 11/06 02:00 to 11/07 02:00.
7Extract311 service requests311 CRM (SaaS)API incremental 775.8SucceededWindow 11/06 02:00 to 11/07 02:00.
8ExtractCAD incident summariesCAD (SQL Server)CDC 867.5SucceededWindow 11/06 02:00 to 11/07 02:00.
9ExtractEmployeesHR (SQL Server)Batch full 1,0465.2SucceededWindow 11/06 02:00 to 11/07 02:00.
10ExtractParcelsArcGIS EnterpriseFeature service snapshot 05.7SucceededWeekly snapshot (Sundays); not due.
11ExtractParks program registrationsSharePoint OnlineFile (Graph export) 57.4SucceededWindow 11/06 02:00 to 11/07 02:00.
12ExtractLegacy performance metric valuesPerformance metrics database (PostgreSQL)Database full 04.0SucceededFull snapshot.
13Cleanse and validateParcelsCDRSQL 05.9SucceededAll blocking rules passed.
14Cleanse and validate311 service requestsCDRSQL 06.2SucceededAll blocking rules passed.
15Cleanse and validateAccounts payable invoicesCDRSQL 06.5SucceededAll blocking rules passed.
16Cleanse and validateUtility billsCDRSQL 06.8Succeeded0 new rows quarantined, 0 released, 6 held.
17Cleanse and validatePermitsCDRSQL 07.1Succeeded0 new rows quarantined, 115 released, 0 held.
18Cleanse and validateInspectionsCDRSQL 07.4SucceededAll blocking rules passed.
19Cleanse and validateCode enforcement casesCDRSQL 07.7SucceededAll blocking rules passed.
20Cleanse and validateWork ordersCDRSQL 08.0SucceededAll blocking rules passed.
21Cleanse and validateCAD incident summariesCDRSQL 08.3Succeeded0 new rows quarantined, 0 released, 11 held.
22Cleanse and validateEmployeesCDRSQL 08.6SucceededAll blocking rules passed.
23Cleanse and validateParks program registrationsCDRSQL 08.9SucceededAll blocking rules passed.
24Cleanse and validateLegacy performance metric valuesCDRSQL 09.2SucceededAll blocking rules passed.
25Build curated layercuratedCDRSQL 38.4SucceededFacts and dimensions rebuilt from cleansed tables.
26Compute metrics and reconcilemetricsCDRSQL 16811.2Succeeded168 of 168 metric months match the legacy performance database within tolerance.

Data as of run R-20261111-0200, finished 11/11/2026 02:13 Central. Curated layer: curated schema.