Senior Databricks Engineer

At DecisionForest we help companies modernise and scale their Databricks data estates. We work hands-on with customers to design pragmatic architectures and build reliable data platforms.

What you will do:

• Build and run production data pipelines and data products on Databricks
• Ingest structured and unstructured data, including extraction, enrichment and automated metadata generation
• Enable ML and LLM deployments with solid MLOps practices (CI/CD, testing, versioning, monitoring)
• Implement data quality and reliability patterns
• Write clean, reusable code and tests
• Work in an agile team

Requirements:

• Strong Python and PySpark, with solid data engineering working experience
• 2+ years building and operating production pipelines
• End-to-end delivery experience: ingestion, transformation, orchestration, data quality, monitoring
• AI prompting and LLM-based extraction or enrichment
• Git, Docker and CI/CD
• Azure and Azure DevOps experience (AWS is a plus)
• Clear communicator, comfortable with SDLC, testing and code reviews
• Proficient English

Nice to have:

• Semantic modelling and knowledge graph concepts
• Secure data handling and encryption

Benefits:

• Work on modern cloud data and AI platforms with leading clients
• Competitive salary depending on experience

Location: Remote.

Who should apply:

If you built production data systems on Databricks, we'd love to chat.