Senior Databricks Engineer - Long Term Mission - Full Remote
Avanda is a Swiss IT Consultancy. We are currently looking for a Senior Databricks Engineer to join our international team at our global end client. This is a long-term opportunity. You can work remotely with a few business trips to Zurich, CH.
THE ROLE
You will join a B2B Sales Data Aggregation programme built on Databricks. The goal is to unify CRM data from Salesforce, Microsoft Dynamics 365, and Excel/SharePoint into a single harmonised platform and deliver high-quality data products and KPI dashboards for senior leadership.
YOUR RESPONSIBILITIES
Design and build ETL pipelines and CDC/incremental connectors for Salesforce & Dynamics 365 using Databricks-native patterns (Auto Loader / Structured Streaming / Jobs)
Implement Bronze → Silver transformations using Delta Lake and reusable SQL/Notebook templates
Develop PySpark notebooks and apply Delta Lake optimisations (compaction, Z-order, caching)
Build automated data-quality checks and deliver KPI dashboards for C-level stakeholders
Set up monitoring, alerting, and job orchestration (Databricks Jobs / Observability)
Document architecture and data lineage (Unity Catalog / Delta time-travel)
Senior Databricks Engineer