logo[мetahunt]
> Djinni

Data Engineer

format:Remote
pythonsqlawsaws s3redshiftaws glueaws lambdaairflowetlgitlab ci/cd
kafkamicrosoft sql serverssisrest-api
englishB2
experience2+ years
> full description

Our client is looking for a Data Engineer.

Role Overview:Our client is looking for a Data Engineer to help them develop and maintain their data platform. Their infrastructure is primarily AWS-based, with Airflow, S3 and Redshift at its core, alongside a legacy stack based on MS SQL Server, SSIS and custom Python scripts. You will work on building reliable data pipelines, improving data infrastructure, and gradually modernising legacy processes.Key Responsibilities:

  • Design, develop and maintain scalable and reliable data pipelines and ETL/ELT processes;
  • Develop and optimise data warehouse solutions;
  • Develop and maintain data infrastructure, primarily on AWS, while also supporting parts of our legacy infrastructure;
  • Develop APIs and data integrations;
  • ontribute to the development and maintenance of real-time data pipelines using Kafka;
  • Automate and optimise data processes and workflows;
  • Monitor, troubleshoot and improve the reliability, performance, security and data quality of pipelines and infrastructure;
  • Work closely with the analytics team and other stakeholders to understand their data needs and deliver effective solutions;
  • Maintain clear and up-to-date documentation for data pipelines, infrastructure and workflows;
  • Contribute to the improvement and modernisation of existing data processes and architecture.

Required Skills & Experience:

  • 2+ years of professional experience in data engineering;
  • Strong SQL and Python skills;
  • Hands-on experience with AWS, including S3, Redshift, Glue and Lambda;
  • Hands-on experience with Apache Airflow;
  • Strong understanding of data warehousing concepts and data modelling;
  • Hands-on experience designing, developing and maintaining production data pipelines, with a focus on reliability, monitoring and data quality;
  • Solid understanding of relational and non-relational databases;
  • Familiarity with Git and CI/CD practices, preferably GitLab;
  • Experience developing APIs and data integrations;
  • Kafka and real-time data processing experience is a plus;
  • MS SQL Server and SSIS experience is a plus;
  • Good written and verbal communication skills;
  • Upper-intermediate English or higher.

The company guarantees you the following benefits:

  • A positive workplace atmosphere that creates a culture of collaboration and support, making it a place you'll love working in;
  • Competitive compensation and regular career development reviews;
  • Flexible working hours and remote working options, you'll enjoy the freedom that the company provides;
  • A generous vacation and sick leave policy, allowing you to take time off and enjoy a work-life balance;
  • Financial assistance for professional development, helping you stay ahead of the curve and love your career path;
  • Educational Allowances that give you the opportunity to expand your knowledge and experience;
  • You'll have a monthly allowance for personal activities, giving you the opportunity to pursue your interests and hobbies outside of work;
  • A comprehensive health insurance plan, depending on your current location;
  • Referral program with financial rewards for bringing top talent to the company;
  • Engaging in team-building activities and corporate parties.

Interview process:

  • HR Interview with the Recruiter;
  • Techincal inetrview;
  • Final interview with the team.

If you find this opportunity right for you, don't hesitate to apply or get in touch with us if you have any questions!