Senior Software Engineer (Data- AWS/Snowflake)

Apply now »

Date: Aug 12, 2024

Location: Erie, PA, US, 16530

Company: Erie Insurance

Division or Field Office:

Corporate Enablement Technology Division
Department of Position: Data Technology Department 

Work from:

 Corporate Office in Erie, Pa
Salary Range:

$85,247.00 - $136,175.00 *

salary range is for this level and may vary based on actual level of role hired for

*This range represents a national range and the actual salary will depend on several factors including the scope and complexity of the role and the skills, education, training, credentials, location, and experience of an applicant, as well as level of role for which the successful candidate is hired. Position may be eligible for an annual bonus payment.

 

At Erie Insurance, you’re not just part of a Fortune 500 company; you’re also a valued member of a diverse and inclusive team that includes more than 6,000 employees and over 13,000 independent agencies.  Our Employees work in the Home Office complex located in Erie, PA, and in our Field Offices that span 12 states and the District of Columbia. 

Benefits That Go Beyond The Basics

We strive to be Above all in Service® to our customers—and to our employees. That’s why Erie Insurance offers you an exceptional benefits package, including:

  • Premier health, prescription, dental, and vision benefits for you and your dependents. Coverage begins your first day of work.
  • Low contributions to medical and prescription premiums. We currently pay up to 97% of employees’ monthly premium costs.
  • Pension. We are one of only 13 Fortune 500 companies to offer a traditional pension plan. Full-time employees are vested after five years of service.
  • 401(k) with up to 4% contribution match. The 401(k) is offered in addition to the pension.
  • Paid time off. Paid vacation, personal days, sick days, bereavement days and parental leave.
  • Career development. Including a tuition reimbursement program for higher education and industry designations.
     

Additional benefits that include company-paid basic life insurance; short-and long-term disability insurance; orthodontic coverage for children and adults; adoption assistance; fertility and infertility coverage; well-being programs; paid volunteer hours for service to your community; and dollar-for-dollar matching of your charitable gifts each year.

 

Position Summary

Translates and develops requirements into workable software solutions. Maintains and develops programs for use in business and IT automation. Incorporates various accepted methodologies to design software and applications at a moderate risk level to project or release. May perform duties in one or more of the following disciplines: Open Systems Mainframe Application Configuration

What You'll Do:

We are seeking a Senior Software Engineer to lead our data engineering team. In this technical leadership role, you will be responsible for architecting and overseeing the implementation of end-to-end data pipelines, integrating AWS services with Snowflake, and ensuring optimal data management practices. You will guide the team in designing and building scalable data solutions and drive initiatives that align with our data strategy, focusing on cloud-native architectures.

  • Lead the architecture, design, and implementation of data pipelines using AWS services, Glue, PySpark, and Snowflake.
  • Define best practices for ETL processes, data management, and cloud data storage in alignment with business goals.
  • Architect, build, and optimize data lakes, warehouses, and data lake house solutions using S3, Redshift, Snowflake, and Glue
  • Ensure efficient data partitioning and storage strategies with Parquet files to enable faster querying.
  • Design and implement real-time streaming data solutions using Kafka and AWS EventBridge.
  • Build and manage APIs using AWS API Gateway for data integrations and processing.
  • Ensure scalability, security, and cost-efficiency of data solutions on AWS.
  • Automate infrastructure provisioning using Terraform and manage containerized applications using Docker.
  • Drive continuous improvement of the data pipeline, monitoring, and alerting frameworks.
  • Implement CI/CD pipelines and maintain DevOps practices to ensure smooth deployment of data solutions.


What Makes You Stand Out:

  • 7-10 years of experience in software engineering with a strong focus on data engineering and cloud technologies.
  • Extensive experience with AWS services: S3, Redshift, Glue, Lambda, Step Functions, DynamoDB, RDS, Athena, EventBridge, API Gateway, and SNS.
  • Advanced knowledge of Snowflake, including architecture, performance tuning, and best practices.
  • Expert in ETL concepts, with a strong background in AWS Glue, Informatica, and data pipeline orchestration.
  • Strong experience with PySpark and Kafka for building data streams and batch processing systems.
  • In-depth knowledge of data partitioning and Parquet files for efficient data storage and querying.
  • Strong experience with SQL, including writing complex queries, and working with databases like Redshift and Snowflake.
  • Proficiency in DevOps concepts, with hands-on experience in CI/CD pipelines, Docker, and Terraform.
  • Excellent understanding of data lake, data warehouse, and data lake house concepts.
  • Proven experience leading teams, mentoring engineers, and managing end-to-end technical implementations.


Preferred Qualifications:

  • Experience working with Redshift Spectrum and Athena for querying large-scale data.
  • Understanding of security best practices for cloud data solutions, including IAM roles and policies.
  • Familiarity with data governance, compliance, and data quality frameworks.

Duties and Responsibilities

  • Incorporates development standards into outcomes and implements basic code and configuration changes under direction.
  • Develops program logic for new, basic applications or analyzes and modifies logic in existing applications.
  • Presents unit tests to an engineer or project leader.
  • Performs supplementary work that contributes to the end product submitted by more experienced developers. Codes, tests, debugs, documents, implements and maintains software applications. Analyzes requirements, and maintains, tests and integrates application components.
  • Effectively communicates with customers, teammates or other stakeholders to determine hardware, software or system functional specifications.
  • Shares knowledge of systems and may mentor or train others. 


The first five duties listed are the functions identified as essential to the job. Essential functions are those job duties that must be performed in order for the job to be accomplished.


This position description in no way states or implies that these are the only duties to be performed by the incumbent. Employees are required to follow any other job-related instruction and to perform any other duties as requested by their supervisor, or as become clear.

 

Competencies

  • Self-Development
  • Collaborates
  • Cultivates Innovation
  • Instills Trust
  • Decision Quality
  • Values Diversity
  • Nimble Learning
  • Customer Focus
  • Optimizes Work Processes
  • Ensures Accountability
  • Coding And Converting
  • Information Management Skills
  • Job-Specific Knowledge
  • Proofing Text And Numbers
  • Using Tables And Graphs

Qualifications

Minimum Educational Requirements and Experience Equivalencies

  • Bachelor's degree in IT, MIS, Business or related field, plus two years' related experience.
  • Associate's degree in technical field, plus four years' related experience.
  • High school diploma plus six years' related experience.

Physical Requirements

  • Lifting/Moving 0-20 lbs; Occasional (<20%)
  • Lifting/Moving 20-50 lbs; Occasional (<20%)
  • Ability to move over 50 lbs using lifting aide equipment; Rarely
  • Driving; Occasional (<20%)
  • Pushing/Pulling/moving objects, equipment with wheels; Rarely
  • Manual Keying/Data Entry/inputting information/computer use; Frequent (50-80%)
  • Climbing/accessing heights; Rarely


Nearest Major Market: Erie