To Apply for this Job Click Here
Location: 1 day/ month on site in Wayne, PA
Position Description
- Perform end-to-end QA of data and ETL/ELT pipelines
- Validate source-to-target mappings, transformations, and business rules
- Write complex SQL for data validation and reconciliation
- Design test plans, test cases, and automated data tests
- Validate data completeness, accuracy, integrity, and consistency
- Build QA automation for Databricks, DLT, and ADF
- Implement schema, constraint, and reconciliation checks
- Automate ADF pre/post-load and schema drift validation
- Build reusable QA frameworks using SQL, Python, and PySpark
- Integrate data QA gates into Azure DevOps CI/CD pipelines
- Perform regression, volume, load, and pipeline testing
- Troubleshoot data issues across source, transformation, and target layers
- Partner with data engineers, architects, governance, and business teams
- Document test results, defects, traceability, and audit evidence
- Mentor junior QA resources
Required Skills
- 8+ years of Data QA/data testing experience
- True Data QA background with hands-on ETL/data pipeline testing
- Advanced, hands-on SQL for complex data validation
- Strong ETL/ELT testing and source-to-target reconciliation
- Data transformation and business-rule validation
- Azure Databricks, Delta Lake, DLT, and Workflows
- Azure Data Factory pipelines and data validation
- Python and/or PySpark for QA automation
- Data quality and pipeline regression automation
- Azure DevOps and CI/CD
- Strong data troubleshooting and root-cause analysis
- Ability to work hands-on while helping drive QA strategy
T1480674-PHI_1793815674