Published: Wed, 23 Jul 2025 20:51:09 GMT
Senior Data Engineer
We are currently seeking a highly skilled Senior Data Engineer to join our team. In this role, you will be responsible for designing, building, and optimizing our big data solutions, with Databricks as our core platform. You will also play a key role in shaping our overall data strategy and driving innovation within our organization.
Key Responsibilities:
– Serve as the Databricks Subject Matter Expert (SME), leading the adoption, optimization, and evangelization of Databricks and its ecosystem.
– Architect, build, and optimize big data solutions using Databricks and other modern data platforms such as Azure SQL, Synapse, and Snowflake.
– Drive our data strategy, ensuring alignment with business goals and best practices. Lead platform governance and ensure compliance with industry standards.
– Continuously optimize Databricks clusters, jobs, and workflows for performance, reliability, and cost-efficiency.
– Lead the development and implementation of best practices for coding, data management, and platform operations. Mentor and upskill engineers, data scientists, and analysts on Databricks features and data engineering best practices.
– Stay updated on the latest industry trends and innovations in data engineering. Engage in Databricks forums, conferences, and user groups to share knowledge and learn from the community.
– Lead incident response efforts, troubleshoot complex issues, and implement long-term solutions.
Qualifications:
– Minimum of 7 years of experience in data engineering, with at least 3 years of experience in architecting and operating Databricks solutions in production environments.
– Expert-level proficiency in Databricks, including Delta Lake and Unity Catalog.
– Experience implementing and optimizing ETL/ELT on modern platforms such as Azure SQL, Synapse, Databricks, and Snowflake, with a demonstrated ability to integrate multiple data sources.
– Expertise in Delta Lake and Apache Iceberg formats for scalable batch and near real-time processing.
– Strong programming skills in Python and PySpark with experience developing production-grade data processing applications and optimizing Spark jobs for performance.
– Strong proficiency in SQL and modern data modeling methods, with the capability to design efficient data structures for analytics.
Requirements:
– Experience building CI/CD pipelines for data platforms using Databricks CLI, Terraform, and Git-based workflows.
– Practical experience with machine learning workflows and MLOps practices, such as model training, versioning, and deployment using Databricks ML tools and MLflow.
– Demonstrated ability to lead teams and mentor junior engineers and data scientists.
– Experience in leading migrations from legacy platforms to modern data platforms, including Databricks.
– Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
Benefits:
– Competitive salary and comprehensive benefits package including medical, dental, vision, 401k, PTO/paid sick leave, and employee stock purchase plan.
– Opportunity to work with cutting-edge technologies and drive innovation within the organization.
– Collaborative and inclusive work environment with opportunities for growth and development.
If you are a highly skilled Senior Data Engineer with a passion for modern data platforms and a drive for innovation, we encourage you to apply for this exciting opportunity. Click on the ‘Apply’ button to find out more and submit your application. Apply link