Data quality

Automated rules run on every load. Blocking rules hold records in quarantine; warnings are scored and routed to the data steward. Results from R-20261111-0200.

Pass rate by dataset, each run

Score by dataset

Dataset	Score	Failing records
Parks program registrations	85.99%	454
Employees	98.66%	28
311 service requests	99.74%	237
CAD incident summaries	99.99%	11
Utility bills	100.00%	6
Permits	100.00%	0
Code enforcement cases	100.00%	0
Accounts payable invoices	100.00%	0
Work orders	100.00%	0
Legacy performance metric values	100.00%	0
Inspections	100.00%	0

Rules

Rule	Dataset	Dimension	Severity	Description	Steward	Checked	Failed	Pass %
DQ-101	Permits	Completeness	Block (quarantine)	Issued or finaled permits have an issue date `status in ('Issued','Finaled') and issued_date is null` fails	Development Services	8,100	0	100.00
DQ-102	Permits	Referential	Warn	Permit parcel exists in the GIS parcel layer `parcel_id not in (select parcel_id from cleansed.arcgis_parcel)` fails	Development Services	8,100	0	100.00
DQ-103	Permits	Validity	Block (quarantine)	Issue date is on or after application date `issued_date < applied_date` fails	Development Services	8,100	0	100.00
DQ-111	Inspections	Validity	Block (quarantine)	Inspection completed on or after request `completed_at < requested_at` fails	Development Services	16,464	0	100.00
DQ-121	Code enforcement cases	Validity	Block (quarantine)	Case closed on or after it was opened `closed_at < opened_at` fails	Development Services	2,350	0	100.00
DQ-201	311 service requests	Validity	Warn	Request location falls inside the City limits `not (lat between 29.54 and 29.66 and lon between -95.70 and -95.56)` fails	Citizen Services (311)	30,400	237	99.22
DQ-202	311 service requests	Validity	Block (quarantine)	Closed time is on or after created time `closed_at < created_at` fails	Citizen Services (311)	30,400	0	100.00
DQ-203	311 service requests	Timeliness	Warn	Open requests older than 90 days are reviewed `status = 'Open' and created_at < :asof - interval '90 days'` fails	Citizen Services (311)	30,400	0	100.00
DQ-301	Work orders	Validity	Block (quarantine)	Work order completed on or after creation `completed_at < created_at` fails	Public Works	22,545	0	100.00
DQ-302	Work orders	Referential	Warn	Service request link resolves to a 311 request `sr_id is not null and sr_id not in (select sr_id from cleansed.crm311_service_request)` fails	Public Works	22,545	0	100.00
DQ-401	CAD incident summaries	Validity	Block (quarantine)	First unit on scene is after dispatch, a clock sync check `on_scene_at < dispatched_at` fails	Police	38,600	11	99.97
DQ-402	CAD incident summaries	Reasonableness	Warn	Response time under 120 minutes `extract(epoch from on_scene_at - received_at) / 60 > 120` fails	Police	38,600	0	100.00
DQ-501	Accounts payable invoices	Validity	Block (quarantine)	Payment on or after receipt `paid_date < received_date` fails	Finance	15,300	0	100.00
DQ-502	Utility bills	Reasonableness	Block (quarantine)	Billed consumption is not negative `consumption_kgal < 0` fails	Utilities	329,988	6	100.00
DQ-601	Employees	Standards	Warn	Race and ethnicity conforms to the DM8 profile `dm8_race_ethnicity is null` fails	Human Resources	1,046	12	98.85
DQ-602	Employees	Standards	Warn	Sex conforms to the City demographic standard `std_sex is null` fails	Human Resources	1,046	16	98.47
DQ-701	Parks program registrations	Standards	Warn	Race and ethnicity conforms to the DM8 profile `dm8_race_ethnicity is null` fails	Parks and Recreation	3,240	454	85.99
DQ-801	Legacy performance metric values	Uniqueness	Block (quarantine)	One value per metric and month `(metric_code, period_month) in (select metric_code, period_month from cleansed_all group by 1, 2 having count(*) > 1)` fails	Office of Data and Innovation	168	0	100.00

Data as of run R-20261111-0200, finished 11/11/2026 02:13 Central. Curated layer: curated schema.