Data Tech Lead (Apache Spark, Pyspark and Databricks Architecture)

Req ID: 306465 

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Data Tech Lead (Apache Spark, Pyspark and Databricks Architecture) to join our team in Plano, Texas (US-TX), United States (US).

Job Duties and Responsibilities:

• Technical Lead with 10+ yrs of experience as well as expertise in data engineering and analytics

• In-depth knowledge of Apache Spark, Pyspark and Databricks architecture.
• Strong programming skills in languages such as Python or Scala. Experience with data engineering concepts, ETL processes, and data modeling.
• Proven experience as a Technical Lead with a focus on Databricks and big data technologies on Azure Cloud Platform.
• Design and implement scalable and efficient data processing architectures using Databricks.
• Handson experience in writing python code, pyspark notebooks and Azure Cloud, Configure Databricks clusters and ensure adherence to best practices and coding standards Make strategic decisions regarding data organization, storage, and processing.
• Lead and mentor a team of data engineers and data scientists.
• Provide technical guidance and support to ensure the team's success.
• Oversee the implementation of data processing workflows, analytics, and machine learning models using Databricks

Basic Qualifications:

• 8+ years of experience in Data Bricks, ADLS (Azure Data Lake Store), PySpark, Azure SQL, Python, SSIS

#INDFSINS

#INDAPPS

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.