PySpark Developer
Apply now »Date: Dec 27, 2020
Location: Carlsbad, CA, US
Company: NTT DATA Services
Req ID: 100011
NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a PySpark Developer to join our team in Carlsbad, California. This role will work remotely during the Covid-19 pandemic until otherwise determined, but will eventually work on location.
Job Responsibilities Include:
- Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate client’s enterprise systems in our Enterprise Data Platform
- Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities
- Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts
- Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements
Basic Qualifications:
- Minimum of 5 years working experience in data integration and pipeline development using Python/PySpark
- Minimum of 2 years of experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
- Bachelors of Science degree in Computer Science, Computer Engineering or Electrical Engineering
Preferred Skills:
- Strong real-life experience in python development especially in PySpark in AWS Cloud environment
- Experience in Python and common python libraries
- Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
- Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools
- Databricks or Apache Spark Experience
- Highly self-driven, execution-focused, with a willingness to do "what it takes” to deliver results as you will be expected to rapidly cover a considerable amount of demands on data integration
- Understanding of development methodology and actual experience writing functional and technical design specifications
- Excellent verbal and written communication skills, in person, by telephone, and with large teams
- Strong prior technical, development background in either data Services or Engineering
- Demonstrated experience resolving complex data integration problems
- Must be able to work cross-functionally. Above all else, must be equal parts data-driven and results-driven
About NTT DATA Services
NTT DATA Services is a global business and IT services provider specializing in digital, cloud and automation across a comprehensive portfolio of consulting, applications, infrastructure and business process services. We are part of the NTT family of companies, a partner to 85 % of the Fortune 100.
NTT DATA Services is an equal opportunity employer and will consider all qualified applicants for employment without regard to race, gender, disability, age, veteran-status, sexual orientation, gender identity, or any other class protected by law.
INDHCLSMC
Nearest Major Market: San Diego
Job Segment:
Consulting, Computer Science, Database, Information Technology, Programmer, Technology