Data Engineer
Reposted 2× across Djinni — deduped to one listing.
metahunt matched 2 postings of this exact role by semantic similarity, so you see it once instead of 2 times.
On behalf of our client, we are looking for a Senior Data Engineer.
About the Project
A global platform managing over 700,000 hotel rooms across 124 countries, helping clients generate billions in revenue.
Responsibilities:
- Implement scaling of the case detection process (scanner)
- Split API into multiple API services
- Emulate pubsub/cloud run locally
- Extract and process data using PySpark + S3
- Work with Kafka/Kinesis data streams
- Write and optimize SQL queries on PostgreSQL/Redshift
- Use DynamoDB as a data source/sink
- Run and debug ETL jobs on Glue or EMR
- Monitor jobs via AWS console and Spark UI
Requirements:
- 5+ years of experience in Data Engineering
- 3+ years of experience with AWS (1+ year in the latest project)
- 2+ years of experience with Spark / PySpark (1+ year in the latest project)
- Strong experience with AWS S3
- Experience with Kafka or Kinesis
- Experience with DynamoDB
- Experience with PostgreSQL or MySQL
- Experience with AWS ECS Fargate
Nice to Have:
- AWS Glue
- EMR
- AWS Batch
- Flink
- Beam
- Cassandra / ScyllaDB
- AWS Step Functions
Company offers:
- Long-term employment with possibilities for professional growth
- Fully remote work
- Reasonably flexible schedule
- 15 days of paid vacation
- Regular performance reviews