Central Data Repository City of Sugar Land, Office of Data and Innovation
PRODUCTION
Jasmine Patel, Police Data Steward (Public Safety Analyst)
View as Administrator Data engineer Utilities steward Police steward
Pipeline runs / R-20261106-0200   Previous run   Next run

Run R-20261106-0200 Succeeded with alerts

Nightly in Production, scheduled 11/06/2026 02:00, finished 11/06/2026 02:13.
Rows extracted2,964
Rows quarantined115
Rows released0
Alerts opened / resolved4 / 0
Reconciliation: Out of tolerance2 metric months
Reconciliation: Within tolerance166 metric months
Metric months outside tolerance.
DS-01 Oct 2026: legacy database 143.0, CDR 55.0, difference -88.0 (tolerance 0.0).
DS-02 Oct 2026: legacy database 5.0, CDR 6.0, difference 1.0 (tolerance 0.1).

Alerts opened in this run

High Resolved Schema change detected in EnerGov permits
Mapped column IssuedDate not found in energov.permit_v11; source now exposes IssueDate. issued_date loaded as null for 119 rows. Check the EnerGov release notes and update the source mapping.
A-1043 to Kevin Tran, Data Engineer. Acknowledged by Kevin Tran 11/06/2026 07:52: EnerGov 11.0 went live last night. Confirmed field rename with Tyler support; mapping v4 in progress (CDR-2291). Resolved by R-20261107-0200.
High Resolved EnerGov permits: 115 records held by DQ-101
Rule DQ-101 (issued or finaled permits have an issue date) failed for 115 records. They are held out of the curated layer until the source is corrected.
A-1044 to Kevin Tran, Data Engineer. Resolved by R-20261107-0200.
High Resolved DS-01 does not reconcile with the legacy performance database
1 month(s) outside tolerance (Oct 2026). For Oct 2026 the CDR shows 55.0 against 143.0.
A-1045 to Marisol Ortega, Data and Innovation Administrator. Acknowledged by Marisol Ortega 11/06/2026 08:20: Holding the October permit numbers from the department dashboard until the replay runs. Resolved by R-20261107-0200.
High Resolved DS-02 does not reconcile with the legacy performance database
1 month(s) outside tolerance (Oct 2026). For Oct 2026 the CDR shows 6.0 against 5.0.
A-1046 to Marisol Ortega, Data and Innovation Administrator. Acknowledged by Marisol Ortega 11/06/2026 08:20: Holding the October permit numbers from the department dashboard until the replay runs. Resolved by R-20261107-0200.

Alerts resolved in this run

None.

Quarantine

DatasetRuleHeld in this runReleased in this run
PermitsDQ-101 Issued or finaled permits have an issue date115

Steps

#StepDatasetConnectorMethodRowsSecondsStatusDetail
1ExtractAccounts payable invoicesTyler MunisCDC 725.8SucceededWindow 11/05 02:00 to 11/06 02:00.
2ExtractUtility billsTyler MunisCDC 1,3958.9SucceededWindow 11/05 02:00 to 11/06 02:00.
3ExtractPermitsEnerGovAPI incremental 1194.1Succeeded with warningsMapped column IssuedDate not found in energov.permit_v11; source now exposes IssueDate. issued_date loaded as null for 119 rows. Window 11/05 02:00 to 11/06 02:00.
4ExtractInspectionsEnerGovAPI incremental 645.8SucceededWindow 11/05 02:00 to 11/06 02:00.
5ExtractCode enforcement casesEnerGovAPI incremental 57.4SucceededWindow 11/05 02:00 to 11/06 02:00.
6ExtractWork ordersCityworksAPI incremental 614.1SucceededWindow 11/05 02:00 to 11/06 02:00.
7Extract311 service requests311 CRM (SaaS)API incremental 925.8SucceededWindow 11/05 02:00 to 11/06 02:00.
8ExtractCAD incident summariesCAD (SQL Server)CDC 1007.5SucceededWindow 11/05 02:00 to 11/06 02:00.
9ExtractEmployeesHR (SQL Server)Batch full 1,0465.2SucceededWindow 11/05 02:00 to 11/06 02:00.
10ExtractParcelsArcGIS EnterpriseFeature service snapshot 05.7SucceededWeekly snapshot (Sundays); not due.
11ExtractParks program registrationsSharePoint OnlineFile (Graph export) 107.4SucceededWindow 11/05 02:00 to 11/06 02:00.
12ExtractLegacy performance metric valuesPerformance metrics database (PostgreSQL)Database full 04.0SucceededFull snapshot.
13Cleanse and validateParcelsCDRSQL 05.9SucceededAll blocking rules passed.
14Cleanse and validate311 service requestsCDRSQL 06.2SucceededAll blocking rules passed.
15Cleanse and validateAccounts payable invoicesCDRSQL 06.5SucceededAll blocking rules passed.
16Cleanse and validateUtility billsCDRSQL 06.8Succeeded0 new rows quarantined, 0 released, 6 held.
17Cleanse and validatePermitsCDRSQL 1157.1Succeeded with alerts115 new rows quarantined, 0 released, 115 held.
18Cleanse and validateInspectionsCDRSQL 07.4SucceededAll blocking rules passed.
19Cleanse and validateCode enforcement casesCDRSQL 07.7SucceededAll blocking rules passed.
20Cleanse and validateWork ordersCDRSQL 08.0SucceededAll blocking rules passed.
21Cleanse and validateCAD incident summariesCDRSQL 08.3Succeeded0 new rows quarantined, 0 released, 11 held.
22Cleanse and validateEmployeesCDRSQL 08.6SucceededAll blocking rules passed.
23Cleanse and validateParks program registrationsCDRSQL 08.9SucceededAll blocking rules passed.
24Cleanse and validateLegacy performance metric valuesCDRSQL 09.2SucceededAll blocking rules passed.
25Build curated layercuratedCDRSQL 38.4SucceededFacts and dimensions rebuilt from cleansed tables.
26Compute metrics and reconcilemetricsCDRSQL 16811.2Succeeded with alerts166 of 168 metric months match the legacy performance database within tolerance.

Data as of run R-20261111-0200, finished 11/11/2026 02:13 Central. Curated layer: curated schema.