ETL Developer

Role Title

Developer (ETL)

In charge of data extraction, processing, storage and maintenance of data from the source systems to the destination system software/applications.

Job Description

We’re looking for someone who:

• Has expertise in extracting data from sources, including databases, CRM systems, flat files, web services etc.
• Transforms the extracted data which involves cleaning, aggregating, mapping, and converting it to ensure it meets the business requirements and is in a suitable format for analysis. Transformation can range from simple operations like changing the data type to complex aggregations or calculations.
• Has ability to Load the transformed data into a target database, data warehouse, or data lake, making it accessible for querying and analysis.
• Has expertise in Java / Python, SQL, Shell Scripting etc.
• Has ability to design the ETL process according to business requirements, ensuring efficient data flow from source to destination and code, configure the pipelines that automate data movement and transformation. This involves writing scripts or using ETL tools.
• Shall implement measures to ensure data accuracy and integrity throughout the ETL process.
• Participate along with Technical Lead in data modelling, designing the data structures and schema in the data warehouse to optimize query performance and align with business needs.
• Troubleshoot and resolve issues like database performance, database capacity, replication, and other data-related issues.
• Optimize ETL processes for speed and efficiency, addressing bottlenecks, and ensuring the ETL system can handle the volume, velocity, and variety of data.
• Work with clients to deliver scalable and maintainable data

You will need to show us that you can:

• Work closely with business analysts, data scientists and IT teams to understand data requirements and deliver the data infrastructure that supports business goals.
• Technical support for ETL systems, troubleshooting issues and ensuring the continuous availability and reliability of data flows.
• Take ownership of code and End to End process of Extraction, Transformation and Load.
• Document the requirements of the system and manage its development.
• Be good Team member and support other teams proactively to achieve end result.

Role Title

Developer (ETL)

In charge of data extraction, processing, storage and maintenance of data from the source systems to the destination system software/applications.

Job Description

We’re looking for someone who:

• Has expertise in extracting data from sources, including databases, CRM systems, flat files, web services etc.
• Transforms the extracted data which involves cleaning, aggregating, mapping, and converting it to ensure it meets the business requirements and is in a suitable format for analysis. Transformation can range from simple operations like changing the data type to complex aggregations or calculations.
• Has ability to Load the transformed data into a target database, data warehouse, or data lake, making it accessible for querying and analysis.
• Has expertise in Java / Python, SQL, Shell Scripting etc.
• Has ability to design the ETL process according to business requirements, ensuring efficient data flow from source to destination and code, configure the pipelines that automate data movement and transformation. This involves writing scripts or using ETL tools.
• Shall implement measures to ensure data accuracy and integrity throughout the ETL process.
• Participate along with Technical Lead in data modelling, designing the data structures and schema in the data warehouse to optimize query performance and align with business needs.
• Troubleshoot and resolve issues like database performance, database capacity, replication, and other data-related issues.
• Optimize ETL processes for speed and efficiency, addressing bottlenecks, and ensuring the ETL system can handle the volume, velocity, and variety of data.
• Work with clients to deliver scalable and maintainable data

You will need to show us that you can:

• Work closely with business analysts, data scientists and IT teams to understand data requirements and deliver the data infrastructure that supports business goals.
• Technical support for ETL systems, troubleshooting issues and ensuring the continuous availability and reliability of data flows.
• Take ownership of code and End to End process of Extraction, Transformation and Load.
• Document the requirements of the system and manage its development.
• Be good Team member and support other teams proactively to achieve end result.