logo[мetahunt]
> Djinni
senior

Backend Engineer

scalaapache icebergdata lake
cc++apache sparkflinktrinoprestoaws s3
> full description

Job Description
Extensive software development experience, including experience working on complex backend or data infrastructure projects.
Strong hands-on experience with Scala.

Experience with Apache Iceberg or similar table formats and data lake technologies.

Hands-on experience developing backend services, data-processing engines, infrastructure components.
Programming experience in C /or C++ is highly desirable / preferred, the role is primarily focused on backend/system-level engineering rather than full-stack application development.
Deep understanding of distributed systems, data processing, storage engines, or data infrastructure.

Strong knowledge of data consistency, transactions, schema evolution, partitioning, compaction, and performance optimization.

Proven ability to troubleshoot complex production and customer issues.

Strong ownership mindset and the ability to operate effectively in areas with limited documentation or historical knowledge.

Excellent communication and collaboration skills.

Preferred Qualifications: 
Big Data Frameworks: Hands-on experience with distributed data-processing technologies such as Apache Spark, Flink, Trino, or Presto.
Cloud Object Storage: Experience working with cloud storage platforms, including Amazon S3, Google Cloud Storage (GCS), or Azure Data Lake Storage (ADLS).
Legacy Modernization: Proven track record of modernizing or gradually improving a mature codebase without disrupting existing customers.
Job Responsibilities
Architect & Build: Lead the architecture, design, and implementation of highly scalable, complex backend systems and robust data infrastructure using Scala.
Data Lake Engineering: Design and manage enterprise-grade data lake solutions leveraging Apache Iceberg or equivalent table formats, ensuring optimal data consistency, transactions, schema evolution, partitioning, and compaction.
Performance Optimization: Maximize system throughput, minimize latency, and optimize resource utilization across large-scale distributed data processing systems.
Production Excellence: Systematically diagnose, troubleshoot, and resolve complex, high-impact production and customer-facing infrastructure issues.
Codebase Modernization: Champion the gradual improvement and modernization of a mature, production-critical codebase without causing disruption to active customers or services.
Technical Leadership & Collaboration: Act as a technical authority, fostering strong communication and collaboration across engineering teams to align on technical objectives.
Navigate Ambiguity: Exercise a strong ownership mindset to operate effectively and deliver high-quality outcomes in areas with limited documentation or historical knowledge.
Department/Project Description
We are seeking an expert Scala Engineer to design, optimize, and scale our next-generation multi-cloud data lake house architecture across AWS and Azure. The ideal candidate is a backend/system engineer with strong experience building engines, infrastructure, or high-performance backend components. In this role, you will leverage Qlik Open Lakehouse (integrated with Qlik Talend Cloud) to establish a low-overhead, high-throughput data foundation. You will manage automated data ingestion, implement continuous table optimization, handle cross-cloud data mirroring, and ensure seamless multi-engine access without vendor lock-in.