AWS Cloud Data Engineer

APPLY NOW »

Date: Jul 26, 2022

Location: Lebanon, NJ, US

Company: New York Life Insurance Co

 

 

When you join New York Life, you’re joining a company that values career development, collaboration, innovation, and inclusiveness. We want employees to feel proud about being part of a company that is committed to doing the right thing. You’ll have the opportunity to grow your career while developing personally and professionally through various resources and programs. New York Life is a relationship-based company and appreciates how both virtual and in-person interactions support our culture.

 

This position is Hybrid based (on-site Tues, Wed, Thurs, work from home Monday and Friday)

The Enterprise Data Management team provides transformative data capabilities and solutions that serve as the core data, reporting, and analytics platform for the Insurance & Agency Group at New York Life (NYL). The Enterprise Data Management team is looking for a Data Engineer with the skills listed below.

 

Build, expand, and optimize data pipeline architecture using Amazon Web Services cloud, Python and Pyspark. Utilize tools like Amazon Relational Database Service (AWS DMS), AWS Database Migration Service (AWS DMS), AWS Glue, Amazon Simple Storage Service (AWS S3), AWS Lambda triggers & functions, etc. Leverage Data Engineering strategies, Data Lake/Lakehouse/Data Warehouse technologies, and streaming/real-time data. Use SQL for data analysis.

 

Responsibilities

  • Design and develop enterprise infrastructure and platforms required for data engineering.
  • Use AWS Cloud technologies to support data needs for expansion of Machine Learning/Data Science capabilities, applications/mobile apps/systems, BI/analytics, and cross-functional teams.
  • Create methods and routines to transition data from on-premise systems to the AWS Cloud.
  • Store data in AWS Cloud platform and develop transformational logic based on business rules.
  • Create and maintain optimal data pipeline architecture. Test and implement data environments.
  • Assemble large, complex data sets to meet functional/non-functional business requirements.
  • Build the infrastructure required for optimal ETL/ELT (extraction, transformation, and loading) of data from a wide variety of data sources using SQL and AWS big data technologies.
  • Utilize AWS Cloud tools like Amazon Relational Database Service (AWS DMS), AWS Database Migration Service (AWS DMS, AWS Glue, Amazon Simple Storage Service (AWS S3), AWS Lambda triggers & functions, etc.
  • Develop and debug code in PySpark/Spark/Python. Use SQL and/or Postgres.
  • Use Data Pipeline, workflow management, and orchestration service tools.
  • Comfortable with SQL for data analysis.
  • Collaborate with Cloud Data Architects, Data Engineers, DBAs, Analytics & Software Engineers.
  • Interact with stakeholders, Product Management, and Design teams to understand requirements and resolve issues.

 

Requirements

  • 5+ years as a Cloud Data Engineer, Data Engineer, Data Architect, AWS Engineer, etc.
  • 3+ years with Amazon Relational Database Service (RDS), AWS Database Migration Service (AWS DMS), Amazon Simple Storage Service (S3) Data Lake, AWS Lambda, etc. in shared service, hybrid environments.
  • Highly scalable Data stores, Data Lake, Data Warehouse, Lakehouse, and unstructured datasets.
  • Data integration, data processing, data streaming, message queuing, and/or ETL/ELT.
  • Ability to lead a team of developers.
  • Bachelor’s degree in Data Science, Computer Engineering, or related field preferred but not required.

SF: LI-CC1

SF: LI-PC1

 

Recognized as one of Fortune’s World’s Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by the Foundation. We're proud that due to our mutuality, we operate in the best interests of our policy owners. We invite you to bring your talents to New York Life, so we can continue to help families and businesses “Be Good At Life.” To learn more, please visit LinkedIn, our Newsroom and the Careers page of www.NewYorkLife.com.

Job Requisition ID: 86981

 

 

 


Job Segment: Cloud, Data Warehouse, Database, SQL, Data Analyst, Technology, Data