Data Technical Lead (Apache Spark, Pyspark and Databricks)

Req ID: 279237 

NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Data Technical Lead (Apache Spark, Pyspark and Databricks) to join our team in Dallas, Texas (US-TX), United States (US).

Job Duties and Responsibilities:

• Technical Lead with 10+ yrs of experience as well as expertise in data engineering and analytics in

• In-depth knowledge of Apache Spark, Pyspark and Databricks architecture.  
• Strong programming skills in languages such as Python or Scala.  

• Experience with data engineering concepts, ETL processes, and data modeling.  
• Proven experience as a Technical Lead with a focus on Databricks and big data technologies on Azure Cloud Platform.  
• Design and implement scalable and efficient data processing architectures using Databricks.
• Handson experience in writing python code, Pyspark notebooks and Azure Cloud, Configure Databricks clusters and ensure adherence to best practices and coding standards.
• Make strategic decisions regarding data organization, storage, and processing. 
• Lead and mentor a team of data engineers and data scientists.
• Provide technical guidance and support to ensure the team's success. 
• Oversee the implementation of data processing workflows, analytics, and machine learning models using Databricks.
• Optimize the performance of big data processing tasks and analytics jobs.
• Collaborate with cross-functional teams, including data science, business intelligence, and infrastructure teams.
• Ensure seamless integration of data pipelines with various systems. 
• Ensure consistency, quality, and maintainability of the codebase. 
• Optimize queries and resolve technical challenges during development and production. 
• Manage the technical aspects of projects, including timelines and resource allocation.
• Coordinate with stakeholders to ensure project goals are met. 
• Excellent leadership and communication skills.  

Basic Qualifications:

• 8+ years of experience in Databricks

#INDFSINS

#INDAPPS

About NTT DATA Services

NTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications, headquartered in Texas. As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications development and management, managed edge-to-cloud infrastructure services, BPO, systems integration and global data centers. We are committed to our clients’ long-term success. Visit nttdata.com or LinkedIn to learn more.

NTT DATA Services is an equal opportunity employer and considers all applicants without regarding to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees. If you need assistance or an accommodation due to a disability, please inform your recruiter so that we may connect you with the appropriate team.