Share this Job

Kafka Data Pipeline Engineer

Apply now »

Date: Jan 16, 2019

Location: Santa Clara, CA, US

Company: NTT DATA Services

Req ID: 31242 


At NTT DATA Services, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company’s growth, market presence and our ability to help our clients stay a step ahead of the competition. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA Services and for the people who work here.


NTT DATA Services currently seeks a Kafka Data Pipeline Engineer to join our team in Santa Clara, California (US-CA), United States (US).



NTT Data Services is Hiring!


Duties and Responsibilities for this position include (what this person will do on a daily/weekly basis):

Need to have Hadoop developement  experience

  • The candidate must have strong experience/exposure across the entire data landscape with the ability to extend traditional data architecture techniques to include big data components. This includes Data Strategy and Architecture development, Data Governance, Master Data Management, Metadata management, Data Integration/ingestion, Data Quality management, Data modeling, Data warehousing, Business Intelligence and advanced Analytics.
  • Must possess a thorough understanding of data management as well as big data technology, tools, processes and data architecture best practices to guide data and big data centric initiatives.
  • Demonstrated ability to liaise closely with business and IT leadership to establish, defend, and negotiate the approach for implementing data management solutions.
  • Serves as an expert consultant to senior IT leadership on Data architecture and enterprise data initiatives.
  • Strong communication, organizational, interpersonal and time management skills; must have the ability to work independently with minimal direction or supervision in a team setting and dynamic environment.
  • Ability to identify and articulate domain specific use cases that can take advantage of big data tools and technologies.


Basic Qualifications:

Minimum five years of experience with the Hadoop ecosystem and Big Data technologies:

  • Expert level software development experience
  • Ability to dynamically adapt to conventional big-data frameworks and tools with the use-cases required by the project
  • Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hbase, Hive, Impala, Spark, Kafka, Kudu, Solr)
  • Experience with building stream-processing systems using solutions such as spark-streaming, Storm or Flink etc.
  • Experience in other open-sources like Druid, Elastic Search, Logstash etc is a plus
  • Knowledge of design strategies for developing scalable, resilient, always-on data lake
  • Some knowledge of agile (Scrum) development methodology is a plus


Desired qualifications for this role include:

  • Hadoop/Cloud Developer Certification
  • MongoDB Developer Certification
  • Experience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clusters


Travel: We are seeking candidates in the San Francisco Bay area or who will relocate.

Degree: Bachelors in Computer Science or equivalent work experience


This position is only available to those interested in direct staff employment opportunities with NTT DATA, Inc. or its subsidiaries.  Please note, 1099 or corp-2-corp contractors or the equivalent will NOT be considered. We offer a full comprehensive benefits package that starts from your first day of employment.                                                                                


About NTT DATA Services


NTT DATA Services partners with clients to navigate and simplify the modern complexities of business and technology, delivering the insights, solutions and outcomes that matter most. We deliver tangible business results by combining deep industry expertise with applied innovations in digital, cloud and automation across a comprehensive portfolio of consulting, applications, infrastructure and business process services.


NTT DATA Services, headquartered in Plano, Texas, is a division of NTT DATA Corporation, a top 10 global business and IT services provider with 118,000+ professionals in more than 50 countries, and NTT Group, a partner to 88 percent of the Fortune 100. Visit to learn more.


NTT DATA, Inc. (the “Company”) is an equal opportunity employer and makes employment decisions on the basis of merit and business needs.  The Company will consider all qualified applicants for employment without regard to race, color, religious creed, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other class protected by law.  To comply with applicable laws ensuring equal employment opportunities to qualified individuals with a disability, the Company will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee unless undue hardship to the Company would result.




Nearest Major Market: San Jose
Nearest Secondary Market: Palo Alto

Job Segment: Database, Consulting, Developer, Computer Science, Cloud, Technology