Data Engineer

We’re looking for a Data Engineer with strong hands-on experience in PySpark and Databricks to join an Insurance domain project. You’ll work on building scalable data processing pipelines and end-to-end data & analytics solutions using Azure, PySpark, Databricks, and Palantir Foundry.

Responsibilities:

• Design and develop data objects and data processing jobs in Azure Data Platform.
• Design and implement E2E analytics solutions using Palantir Foundry Platform, including: various types of data sources and data connections, scalable data transformation pipelines in PySpark.
• Optimize and automate data processing jobs and transformation pipelines through reviewing of logs and query plan, partitioning and code simplification.
• Ensure data quality, security (access concept) and governance across the whole flow of data & analytics solution.
• Collaborate with cross-functional teams and stakeholders to understand and translate. business requirements into technical specifications and actionable plans, ensuring successful delivery.
• Troubleshoot and resolve functional and technical data issues for stakeholders, actively contributing to shared goals and supporting peers in solving technical and analytical challenges.

Requirements:

• 4+ years of professional experience in data engineering roles.
• Strong hands-on experience with data transformation jobs/pipelines and complex data & analytics solution.
• Expertise in Python/PySpark and experience with distributed computing frameworks like Spark.
• Proficiency/advanced in SQL.
• Proficiency with Git.
• Experience with cloud platforms (Azure, AWS), specifically Azure Databricks and Palantir Foundry is a significant advantage.
• Proven ability to work across business and technical teams, supporting requirement definition and solution design.
• Agile mindset and practical experience with Scrum or other agile frameworks, Azure DevOps is a plus.
• Strong team player with excellent communication skills, proactive mindset, and a collaborative approach.
• English at B2 or higher.
• Bonus: knowledge of REST API or Power BI.

Please note that feedback on the results of the CV review will be provided only in the event of a decision to consider your candidacy further.
Otherwise, your data will be retained in the company’s CV database, and we will gladly contact you if a suitable vacancy becomes available. The consideration period is 7 working days.

Before sending us your CV, you may read our Privacy Notice.

Відгукнутись на вакансію