SC Cleared Databricks Data Engineer - Hybrid - Outside IR35
other jobs Tenth Revolution Group
Added before 3 Days
- England,North East,Tyne and Wear,Newcastle upon Tyne
- Full Time, Contract
- £500 - £600 per day
Job Description:
SC Cleared Databricks Data Engineer - Hybrid - Outside IR35
We are seeking a skilled Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics platforms. In this role, you will work closely with data scientists, analysts, and product teams to deliver reliable, high-performance data solutions using Databricks and modern cloud technologies.
Key Responsibilities * Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake
* Build and optimize ETL/ELT workflows for batch and streaming data
* Develop data models to support analytics, reporting, and machine learning use cases
* Ensure data quality, reliability, and performance across data platforms
* Integrate data from multiple sources including APIs, databases, and cloud storage
* Collaborate with data scientists and analysts to enable advanced analytics and ML workloads
* Implement monitoring, logging, and cost-optimization best practices
* Follow data governance, security, and compliance standards
* Document data pipelines, architectures, and best practices
Required Qualifications * 3+ years of experience in data engineering or a similar role
* Strong experience with Databricks and Apache Spark
* Proficiency in Python and SQL
* Experience with Delta Lake, data modeling, and performance tuning
* Hands-on experience with cloud platforms (AWS, Azure, or GCP)
* Familiarity with data orchestration tools (e.g., Airflow, Azure Data Factory)
* Solid understanding of data warehousing and big data concepts
Preferred Qualifications * Experience with real-time/streaming data (Spark Structured Streaming, Kafka, etc.)
* Knowledge of CI/CD for data pipelines
* Experience supporting machine learning pipelines
* Databricks or cloud platform certifications
To apply for this role please submit your CV or contact Dillon Blackburn on or at .
Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We’re the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.
We are seeking a skilled Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics platforms. In this role, you will work closely with data scientists, analysts, and product teams to deliver reliable, high-performance data solutions using Databricks and modern cloud technologies.
Key Responsibilities * Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake
* Build and optimize ETL/ELT workflows for batch and streaming data
* Develop data models to support analytics, reporting, and machine learning use cases
* Ensure data quality, reliability, and performance across data platforms
* Integrate data from multiple sources including APIs, databases, and cloud storage
* Collaborate with data scientists and analysts to enable advanced analytics and ML workloads
* Implement monitoring, logging, and cost-optimization best practices
* Follow data governance, security, and compliance standards
* Document data pipelines, architectures, and best practices
Required Qualifications * 3+ years of experience in data engineering or a similar role
* Strong experience with Databricks and Apache Spark
* Proficiency in Python and SQL
* Experience with Delta Lake, data modeling, and performance tuning
* Hands-on experience with cloud platforms (AWS, Azure, or GCP)
* Familiarity with data orchestration tools (e.g., Airflow, Azure Data Factory)
* Solid understanding of data warehousing and big data concepts
Preferred Qualifications * Experience with real-time/streaming data (Spark Structured Streaming, Kafka, etc.)
* Knowledge of CI/CD for data pipelines
* Experience supporting machine learning pipelines
* Databricks or cloud platform certifications
To apply for this role please submit your CV or contact Dillon Blackburn on or at .
Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We’re the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.
Job number 3366731
Increase your exposure to recruiters with ProJobs
Thousands of recruiters are looking for you in the Job Master profile database, increase your exposure 4 times with a ProJob subscription
You can cancel your subscription at any time.