Will design and implement Azure Pipelines for data ingestion from diverse databases generating dimension & fact tables aligned with the logical data model. Facilitate the transfer and parallel execution of data seamlessly through Azure Data Factory (ADF), resulting in improvement in data efficiency. Write and automate stored procedures that hold business aggregations needed for operations, sales & visualization. Orchestrate the creation & deployment of pipelines through Azure Data Factory leading to decrease in processing time. Build Medallion Architecture which holds organizational data in Bronze, Silver & Gold layers for enhanced cost savings by eliminating the need of legacy on prem systems. Implement Kafka’s producer consumer architecture to stream the data from source system to data lake and then to bronze layer for downstream consumption. Develop data bricks Notebooks using Pyspark and SparkSQL. Collaborate with cross-functional teams to formulate and execute scalable data architectures while also establishing data governance protocols.
Position requires up to 100% domestic travel. This position is for full-time, salaried (W-2), permanent employment.
REQUIREMENTS: Master’s Degree or foreign equivalent in Information Technology, Business Analytics, or a related field.
Please reference Job Number 906717 when sending resumes. Please mail resumes to: HR, Beacon Hill Solutions Group, LLC, 20 Ashburton Place, 5th Floor, Boston, MA 02108.
California residents: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
If you would like to complete our voluntary self-identification form, please click here(opens in new tab) or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/jobs/eeoc/
Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.
Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings.