Data Engineer

Responsibilities 

• Design, develop, and maintain backend application logic for invoice retrieval, validation, processing, and routing.
• Integrate with external systems through REST APIs using JSON and OAuth 2.0, including content-based routing scenarios.
• Build, deploy, and operate the solution as a Databricks App using Databricks Workflows, Delta Lake, and Unity Catalog.
• Develop and maintain an operational user interface for monitoring processing status, exceptions, and error handling.
• Implement robust logging, monitoring, observability, and error-handling mechanisms to ensure production reliability.
• Apply strong software engineering practices, including version control, CI/CD, automated unit and integration testing, and controlled deployments.
• Troubleshoot production issues and continuously improve application stability, performance, and maintainability.
• Collaborate with business and technical stakeholders to clarify requirements and deliver reliable application functionality.

     Requirements

• Strong hands-on experience with Databricks Apps, Databricks Workflows, Delta Lake, and Unity Catalog.
• Experience with e-invoicing solutions or invoice-processing workflows.
• Strong Python backend development skills, including validation logic, routing, API integrations, and application-level processing.
• Solid experience working with REST APIs, JSON, OAuth 2.0, and content-based routing patterns.
• Hands-on experience developing user interfaces with Streamlit or React within Databricks Apps.
• Good practical experience with Git, CI/CD pipelines, automated unit and integration testing, logging, monitoring, and production support.
• Strong understanding of software engineering principles and production-grade application development.
• Proven experience delivering and supporting stable production applications, rather than working exclusively with data pipelines.
• Strong troubleshooting and problem-solving skills, with the ability to diagnose application and integration issues.

Nice to have

• Experience integrating with SAP Ariba, ERP, procurement, or related enterprise platforms.
• Knowledge of UBL, PEPPOL, or similar electronic invoicing standards.
• Previous experience delivering and operating Databricks Apps in production environments.