Data Engineer (#440150E)

Will identify all available internal and external data sources (including GIS and asset systems) needed to meet business objectives. Conduct feasibility analysis and prepare technical design documentation to guide implementation across multiple enterprise data platforms. Determine data refresh frequency (real-time vs batch), platform-specific data access needs (e.g., Foundry, Snowflake), required file formats (structured/unstructured), and the appropriate data granularity required for visualization or reporting. Prepare data flow diagrams and process flow documentation that outline ingestion, transformation, and loading (ETL/ELT) workflows across PG&E’s data architecture using tools like Informatica and Python. Design logical and physical data models based on asset metadata, measurement hierarchies, and spatial data dependencies. Guide developers and QA analysts with detailed database specifications. Build physical schema structures across Snowflake, define column names, data types, default values, primary/foreign keys, and indexing strategies for performance optimization. Document entity-relationship models, data constraints, and cardinality ratios. Establish user access policies and define data object-level permissions as per enterprise security standards. Perform impact analysis of data model or rule changes across upstream and downstream applications, dashboards, and workflows. Engage multiple teams in evaluating database object usage and transformation dependencies. Define ETL/ELT patterns to be followed depending on the source system (CSV, JSON, database dumps, GIS exports, etc.) and the target schema in Snowflake or Foundry. Decide which dashboards or metric views (Foundry/Power BI) will consume each dataset. Prepare mock test data covering all edge cases and validating transformation logic by simulating real-world utility scenarios (e.g., outages, maintenance events, asset failures) to ensure robustness of data pipelines. Create mapping documents that define column-level transformation rules from raw source to curated target zones. Support translation of business logic into data quality rules and governance metadata. Design and create all relevant database objects: tables, views, stored procedures, macros, and triggers. Define Change Data Capture (CDC) logic where needed and participate in data migration planning. Write and optimize SQL scripts to meet performance, scalability, and data quality standards. Document scripts thoroughly, adhering to enterprise data engineering coding guidelines and promoting reusability. Troubleshoot database or transformation issues across the stack. Provide hands-on support for error triage, stored procedure bugs, and data quality anomalies flagged by dashboards or rule alerts. Lead efforts to resolve complex data integrity and inconsistency issues using detailed comparisons of pre- vs post-load stats, analyze I/O performance, and perform SQL tuning to reduce query CPU load. Manage version control and documentation of all data pipelines and models in shared repositories (e.g., Git, Confluence), and support enterprise data catalog efforts through Collibra.

Position requires up to 100% domestic travel. This position is for full-time, salaried (W-2), permanent employment.

REQUIREMENTS:

Position requires a Master’s Degree or foreign equivalent in Computer Science, Information Technology, Information Systems, Engineering or a related field, and one (1) year of experience in the Software Industry.

Please reference Job Number 440150E when sending resumes. Please mail resumes to: HR, Beacon Hill Solutions Group, LLC, 20 Ashburton Place, 5^th Floor, Boston, MA 02108.

California residents: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/jobs/eeoc/

Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.

Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility.  Upon successfully being hired, details will be provided related to our benefit offerings.