Data Platform Engineer

Role Location: New York City (Primary), Clinton, NJ, Dallas, TX, Jersey City, NJ, White Plains, NY also an option

The Enterprise Data Management organization is tasked with creating and delivering a technology strategy for New York Life's Data & Analytics.  The continued evolution of this data strategy requires a Data Platform Engineer with AWS expertise to help drive the next phase of the journey! 

Serving as a Data Platform Engineer, this provides a unique opportunity to help shape and influence one of the most strategic initiatives at New York Life.  The position will be responsible for building enterprise data management platforms both on-premise and in the cloud. It is expected that this engineer will architect and build out the core data platforms for the enterprise. This role will require an advanced skillset across a variety of technologies. This individual will often have to learn on their own and remain on the cusp of new technologies in the Big Data, Analytics, and Cloud space.

Primary Responsibilities

• Accountable for designing and delivering against New York Life’s data technology strategy
• Work with a team of engineers and developers to deliver against the overall technology data strategy
• Ensure enterprise data platforms are standardized, optimized, available, reliable, consistent, accessible and secure to support business and technology needs
• Understand data related initiatives within New York Life and engineer optimal designs and solutions
• Drive knowledge management practices for key enterprise data platforms and collaborate with team members
• Collaborate with peers across Enterprise Data Management, to deliver on the overarching strategy
• Develop framework, metrics and reporting to ensure progress can be measured, evaluated and continually improved
• Stay current and informed on emerging technologies and new techniques to refine and improve overall delivery

Desired Qualifications:

• 8+ years in a variety of technology – especially AWS, Big Data, Linux, Web, and Databases
• Experience with Cloudera's Data Platform (CDP), Hortonworks Data Platform (HDP), and the AWS stack is highly preferred
• Deep expertise in data related tools including latest data solutions (i.e. Big Data, Cloud, In Memory Analytics, etc.)
• Hands-on experience with Hadoop, NoSQL DBs, Big Data warehouses, and insights on when to recommend a particular solution
• Solid experience in standing up enterprise practices for Big Data, Analytics, Self-Service
• Track record for identifying, architecting and building new technology solutions to solve complex business problems
• Capable of working with open source software, debugging issues and working with vendors toward effective resolution

Competencies:

• Thinks strategically - sets overall direction for solution design and delivery for enterprise platforms aligned to the data & analytics strategy
• Results Driven - sets aggressive goals and is accountable for continuously driving improved outcomes, leading change and ensuring high standards
• Excellent communication, both written and verbal in conveying technical design and approach for delivering technical solution
• Pragmatic in his/her approach, delivering incrementally and demonstrating value
• Ability to help train/develop resources on the team
• Other competencies: critical thinker, adaptable, self-starter, demonstrates sound judgment

Required:

• Expertise with AWS technologies (EC2, S3, Glue, Athena, RedShift, CloudFormation, LakeFormation, Terraform, etc.).  AWS certifications highly preferred
• Solid understanding of Hadoop technologies (YARN, Hive, MR, Tez, Spark, etc.)
• Proficient with Unix/Linux (building/assembling packages, shell scripts, configuration management and OS tuning)
• Knowledge of configuration management/automation tooling (Puppet/Chef/Salt/Terraform)
• Experience with Java, Python and API's
• Knowledge of enabling Kerberos and best practices for securing data a plus
• Experience working with Vendors/Open Source in the Data and Cloud ecosystem
• Knowledge of the open source community (opening issues, tracking issues and identifying problematic issues ahead of time by tracking open JIRA issues in the community)
• Understanding of Networking (tracing, packet capture, etc.)