> DOU
senior
Future Processing UkraineData Engineer
format:Remote
databricksazure synapsepythonsqlapache sparkeltetlany one ofeltdata lakeazure data factoryci/cdazure devops
> full description
We’re looking for an experienced Azure Data Engineer to help develop, modernize, and maintain a large-scale enterprise data platform.
You’ll work with Azure Databricks, Synapse, and Lakehouse technologies, building reliable data pipelines and supporting analytics and AI/ML initiatives.
The environment is dynamic, with changing priorities and a relatively lightweight management structure. We’re looking for someone who enjoys taking ownership, solving complex problems, and making technical decisions independently.
Your Responsibilities
- Develop and maintain scalable data pipelines using Azure Databricks, Synapse, Python, SQL, and Spark.
- Support migration from Hive Metastore to Databricks Unity Catalog.
- Migrate and optimize Delta Live Tables (DLT), Databricks jobs, and Synapse/ADF pipelines.
- Develop and maintain metadata-driven frameworks for data ingestion.
- Build integrations across financial, operational, HR, and other enterprise systems.
- Improve data processing performance, reliability, quality, and security.
- Troubleshoot production issues and implement sustainable solutions.
- Collaborate with Data Architects, analysts, developers, and business stakeholders.
- Contribute to CI/CD, automation, monitoring, and engineering best practices.
Technical Requirements
- Strong commercial experience with Azure Databricks and Azure Synapse Analytics.
- Advanced skills in Python, SQL, and Apache Spark.
- Experience with ETL/ELT development and enterprise data pipelines.
- Good understanding of Data Lakehouse architecture and Delta Lake.
- Experience with Databricks workflows, Delta Live Tables, and Unity Catalog.
- Knowledge of Azure Data Factory and Azure Data Lake.
- Familiarity with CI/CD, Azure DevOps, and production monitoring.
- Understanding of data governance, security, and performance optimization.
- English B2+.