Share this Job

Date: Jan 9, 2019

Location: Halifax, NS, CA

Company: NTT DATA Services

At NTT DATA Services, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company’s growth, market presence and our ability to help our clients stay a step ahead of the competition. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA Services and for the people who work here.





NTT DATA Services currently seeks a Hadoop Administrator to join our team in Halifax, NS.


- Work with Linux administration team (NTT DATA Cloud team) to provision set of Linux nodes required for Hadoop cluster.

- Installing and configuring Hadoop stack on set of nodes using automation deployment tools like Apache ambari etc. based on various Hadoop distributions.

- Adding or decommissioning nodes from Hadoop cluster based on data load to be processed on the system.

- Configure different Hadoop services like hdfs, mapreduce, hive, pig, sqoop, hbase, spark, storm, kafka, zookeeper etc. based on the use case need to implemented.

- Configure High Availability for Namenode, Resource Manager, Hbase Master etc. in Hadoop cluster to avoid single point of failure issue in the system.

- Identify and configure scheduler(fair/capacity) suitable for workload being scheduled on the cluster

- Monitor health of Cluster components using monitoring tools like Apache Ambari, Nagios, Gangila, Cloudera manager etc.

- Perform periodic health checks on cluster to make sure system is available all the time for fulfilling business requirements.

- Monitoring the HDFS filesytem  and logs effectively for any errors.

- Monitor resources like CPU/Memory and storage  on cluster nodes using metrics in automation tools like apache ambari.

- Changing the core Hadoop configuration files like hdfs-site.xml,core-site.xml,mapred-site.xml,yarn-site.xml and specific files related Hadoop services like hive, pig, spark etc. for any performance, scaling, application related issues etc.

- Taking the backup regularly and restore the data whenever required.

- Creating and managing users in Hadoop cluster as part of user management.

- Work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.

- Working on capacity planning activities like scale up/scale down nodes from cluster based on data load to be processed on the system.

- Prepare and maintain documents on configuration changes and best practices.

- Troubleshooting various issues like space related, memory related, application related, different types of failures, performance related, spark jobs execution issues, high availability related, edge node related issues etc.

- Tuning the Cluster Resources, Optimizing Map Reduce Jobs and Benchmarking.

- Rebalancing the data across the data nodes in the cluster using balancer tool.

- Applying patches related to security, stability, fixes, features periodically to Hadoop services whenever they are available.

- Upgrading Hadoop stack on Hadoop cluster to latest version to fulfil the business requirements.



- 5 years of experience with Developer-BIG Data (BD)-Hortonworks Hadoop-HDInsight/HDFS/Base/flume/Scoop/MapReduce/Yarn.

This position is only available to those interested in direct staff employment opportunities with NTT DATA, Inc. or its subsidiaries.  Please note, contractors or the equivalent will NOT be considered. We offer a full comprehensive benefits package that starts from your first day of employment.                                                                                


About NTT DATA Services


NTT DATA Services partners with clients to navigate and simplify the modern complexities of business and technology, delivering the insights, solutions and outcomes that matter most. We deliver tangible business results by combining deep industry expertise with applied innovations in digital, cloud and automation across a comprehensive portfolio of consulting, applications, infrastructure and business process services. NTT DATA Services, headquartered in Plano, Texas, is a division of NTT DATA Corporation, a top 10 global business and IT services provider with 118,000+ professionals in more than 50 countries, and NTT Group, a partner to 88 percent of the Fortune 100. Visit to learn more.

Job Segment: Developer, Consulting, Administrative Assistant, XML, Cloud, Technology, Administrative