ETL Development Lead

Req ID: 374353 

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a ETL Development Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN).

Job Title: Offshore ETL/Data Engineer 

Role Summary

We are seeking a skilled Offshore ETL/Data Engineer to support enterprise data integration, transformation, and modernization initiatives. The candidate will build scalable data pipelines and contribute to next-gen data solutions incorporating AI/ML capabilities along with legacy ETL modernization.

Key Responsibilities

• Design, develop, and maintain ETL pipelines using Informatica, Azure Data Factory (ADF), and Databricks
• Perform migration of legacy ETL workflows (Informatica) to Databricks using Python/PySpark
• Analyze existing ETL workflows and re-engineer into optimized Spark-based transformations
• Develop data processing and transformation solutions using Python and PySpark
• Apply AI/ML techniques for data enrichment, anomaly detection, and predictive insights (where applicable)
• Build and optimize SQL queries, data models, and transformations
• Schedule and monitor jobs using AutoSys
• Integrate data from multiple sources:
• Relational databases (SQL Server, DB2)
• Files (CSV, XML, JSON)
• Mainframe systems
• Streaming platforms like Kafka
• Perform data validation, reconciliation, and ensure data quality
• Troubleshoot ETL/pipeline failures and optimize performance
• Collaborate closely with onshore teams for development and production support

Work Schedule Requirement

• Offshore support coverage required up to 3:00 PM Central Time (CT) i.e., 2:30AM IST
• Ensure strong overlap for batch monitoring, issue resolution, and critical support

Required Skills

• Strong experience in Informatica ETL development
• Proven experience in Informatica to Databricks migration
• Strong programming skills in Python and PySpark
• Hands-on experience with Databricks and Azure Data Factory (ADF)
• Proficient in SQL (complex query development and optimization)
• Experience with AutoSys job scheduling
• Experience integrating data from:
• DB / DB2 / Mainframe systems
• Files and streaming platforms (Kafka)
• Solid understanding of ETL re-engineering, transformation logic conversion, and Spark optimization

AI / ML Skills (Preferred)

• Basic to intermediate understanding of AI/ML concepts and data pipelines for ML workloads
• Experience using Databricks ML / MLflow / notebooks for model tracking and experimentation
• Ability to support data preparation for machine learning models (feature engineering, dataset curation)
• Exposure to Python ML libraries (e.g., Pandas, Scikit-learn)
• Experience or familiarity with:
• Anomaly detection / predictive analytics use cases
• Data pipelines supporting AI workflows
• Understanding of LLM / GenAI integration with data platforms (preferred but optional)

Preferred Qualifications

• Experience with Azure cloud data ecosystem
• Exposure to Data Lake / Lakehouse architecture
• Familiarity with CI/CD and DevOps practices
• Experience in batch + streaming data processing patterns

Soft Skills

• Strong communication and coordination with offshore/onshore teams
• Ability to work independently in a fast-paced environment
• Proactive in identifying modernization and AI-driven opportunities

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

Whenever possible, we hire locally to NTT DATA offices or client sites. This ensures we can provide timely and effective support tailored to each client’s needs. While many positions offer remote or hybrid work options, these arrangements are subject to change based on client requirements. For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs. At NTT DATA, we are committed to staying flexible and meeting the evolving needs of both our clients and employees. NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, https://us.nttdata.com/en/contact-us.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.