Data Engineering Advisor – Python / PySpark [T500-13779]

Job Description

Software Engineering Advisor – Data Governance, Data Model, Data Migration, Automation

Position Overview:
The job profile for this position is Software Engineering Advisor, which is a Band 4 Contributor Career Track Role.

Excited to grow your career ?
We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position, you see is right for you, we encourage you to apply!
Our people make all the difference in our success.

We are looking for exceptional Data Model, Data Governance, and Data Migration experts including expertise in automation, in our PBM Plus Technology organization. This role requires ensuring data integrity, efficiency, and compliance across the project as well as designing and implementing robust data governance frameworks, leading data migration projects, and developing automation scripts to enhance data processing and management.
This role involves working with critical data across customer, provider, claims, and benefits domain to ensure comprehensive data solutions and high-quality deliverables.
and deploying in on prem and/or AWS infrastructure using the technologies listed below. They are expected to work closely with Subject Matter Experts, developers, and business stakeholders to ensure that application solutions meet business/customer requirements.

Responsibilities:
Data Governance:
Design and implement comprehensive data governance frameworks and policies.
Ensure adherence to data governance standards and best practices across the organization.
Collaborate with data stewards and stakeholders to enforce data policies and procedures.

Data Modeling:
Develop and maintain logical and physical data models for enterprise data warehouses, data lakes and data marts.
Ensure data models are optimized for performance and scalability.
Document data models and maintain metadata repositories.

Data Migration:
Lead data migration projects, ensuring data accuracy, consistency, and completeness.
Develop and execute data migration strategies and plans.
Perform data extraction, transformation, and loading (ETL) using industry-standard tools.

Automation:
Develop automation scripts and tools to streamline data processing and management tasks.
Implement automated data quality checks and validations.
Continuously improve and optimize data automation processes.

Collaboration:
Work closely with data architects, data analysts, and other IT teams to ensure seamless data integration and consistency.
Provide technical guidance and support to junior team members.
Support other product delivery partners in the successful build, test, and release of solutions.
Work with distributed requirements and technical stakeholders to complete shared design and development.
Works with both onsite (Scrum Master, Product, QA and Developers) and on and offshore team members in properly defining testable scenarios based on requirements/acceptance criteria.
Be part of a fast-moving team, working with the latest tools and open-source technologies
Work on a development team using agile methodologies.
Understand the Business and the Application Architecture End to End
Solve problems by crafting software solutions using maintainable and modular code.
Participate in daily team standup meetings where you’ll give and receive updates on the current backlog and challenges.
Participate in code reviews. Ensure Code Quality and Deliverables
Provide Impact analysis for new requirements or changes. Responsible for low level design with the team

Qualifications
Required Skills:
Extensive experience in data modeling, governance, and migration and proficient in data management tools (e.g. Erwin, etc.)
Technology Stack: Python, Py-Spark, Lambda, AWS Glue, Redshift, Athena, SQL
Proficient in working with the SAM (Serverless Application Model) framework, with a strong command of Lambda functions using Java/Python and programming and scripting skills (Python, SQL, Shell scripting)
Proficient in internal integration within AWS ecosystem using Lambda functions, leveraging services such as Event Bridge, S3, SQS, SNS, and others.
Experienced in internal integration within AWS using DynamoDB with Lambda functions, demonstrating the ability to architect and implement robust serverless applications.
CI/CD experience: must have GitHub experience.
Recognized internally as “the go-to person” for the most complex software engineering assignments

Required Experience & Education:
11+ years of experience
Experience with vendor management in an onshore/offshore model, including managing SLAs and contracts with third-party vendors
Proven experience with architecture, design, and development of large-scale enterprise application solutions.
College degree (Bachelor) in related technical/business areas or equivalent work experience.
Industry certifications (e.g. CDMP, DGSP, etc.)