Systems Integration Senior Specialist

Profile Summary:

We need a profile that is autonomous developing pyspark code on Databricks notebooks to make a migration from a SAS ETL to Databricks using Python. You should know and be familiar with code repositories and good development practices, being clear about the concepts of Gitflow. Should be able to speak in Spanish apart from English

List of Key Responsibilities:

• Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into Integrated data platform.
• Participate on the development of product features in databricks as: cost control reports, alerting methods, automated created of objects using the dbicks API, etc.
• Work with cloud-based technologies, Databricks, and AWS Cloud, to deploy and manage data solutions.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data-driven solutions.
• Monitor and troubleshoot data processing issues, identifying and resolving root causes promptly.
• Utilize Azure DevOps for version control, continuous integration, and deployment of data-related artifacts.
• Collaborate with the data architecture team to design and develop solutions for integration with other platforms with databricks (snowflake, informatica, etc)
• Stay up-to-date with emerging data engineering trends, technologies, and best practices, and propose their integration when relevant.

Technical Knowledge:

*

List of Used Tools:

•  IDEs: Intellij, Visual Studio

•         Databricks, notebooks, python

•         Azure Devops

•         SQL

•         SAS

•         GIT