Other Focus Areas
Current Projects
Pay Data Reporting (PDR) Program Data Analysis and Reporting Services
For the Civil Rights Department (CRD), Mission developed and maintains a Python-based pipeline that processes annual pay data from private employers with 100 or more employees, as mandated by California law. The pipeline conducts data validations, including deduplication, outlier detection, and address validation through geocoding using the ArcGIS REST API. Based on observed data issues, Mission provides strategic recommendations to improve future data collection and error handling. Each year, Mission delivers an internal dataset for CRD analysts, and a public-use data model, ensuring employee and employer confidentiality through statistical disclosure techniques. Additionally, Mission proposes and implements data linkage strategies to produce longitudinal data files which aid in year-over-year employer tracking and reporting enforcement.
