Sr Data Engineer (Life and Annuity)

NTT DATA is a $30+ billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world’s leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services.  Our consulting and industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is part of NTT Group, which invests over $3 billion each year in R&D.

Job Duties:

•    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. 
•    Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.
•    Strong Application development experience in Scala/Python.•    Strong Database SQL experience, preferably Redshift.•    Experience in Snowflake is an added advantage.
•    Experience with ETL/ELT process and frameworks is a must.
•    Create integration and application technical design documentation.
•    Conduct peer-reviews of functional design documentation.
•    Complete development, configuration, test cases and unit testing 
•    Perform code reviews and ensure standards are applied to each solution component.
•    Resolve complex defects during testing phases and identify root causes.
•    Support and execute performance testing.
•    Familiar with Git repo and CI/CD deployment process
•    Production Support: Assist in troubleshooting production environment and tuning environments.
•    Ensure best practices are followed from a technical perspective during all phases of the project.

Minimum Skills Required:

• Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshift
• Expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL
• Proficient in Python programming for data engineering tasks, automations
• Experience with shell scripting in Linux/Unix environments.
• Experience with Big Data – Hadoop, Spark
• Financial Services experience required
• Nice to have - knowledge in Machine Learning models, regression, validation

NTT DATA is a $30+ billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world’s leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services.  Our consulting and industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is part of NTT Group, which invests over $3 billion each year in R&D.