Contract

Data Engineer (Databricks)

Ref: BBBH67926_1787044968
Cambridge, Cambridgeshire

Data Engineer (Databricks)

Whitehall Resources currently require an experienced Data Engineer (Databricks) to work with a key client.

**Please note this role requires falls INSIDE IR35**

Responsibilities:

  • Design build, test, deploy and maintain lightweight analytics application, primarily using python and streamlit, to support training and onboarding
  • Translate business and user requirements into intuitive application workflows, well-structured data models and transparent metrics.
  • Work closely with Data engineers to ensure data pipelines and reusable data sets meet application and analytical needs
  • Maintain application code in version control and contribute to testing, technical documentation and development best practices
  • Develop and maintain reusable datasets, semantic layer, data quality checks, monitoring and reporting for the data used by the applications.
  • Gather user feedback and iteratively improve application usability, accessibility and adoption
  • Build dashboards and visualisations where they are the most appropriate way to communicate onboarding, adoption and business metrics
  • Support onboarding of new users to the data platform, improving accessibility and usability

Required Skills and Experience:

  • Hands on experience developing data or analytic applications in Python using Streamlit, Dash or a similar framework
  • Experience designing, testing and maintaining user-facing applications, including the use of version control
  • Strong SQL skills and experience analysing and integrating data sets from multiple sources
  • Experience with Databricks (or similar modern data platforms)
  • Working experience with notebooks and Python data libraries and processing frameworks (e.g. Pandas, PySpark)
  • Understanding of deployment, CI/CD, orchestration and application support practices.

“Nice To Have” Skills and Experience :
Experience building dashboards and visualisation using (Databricks SQL, Power BI, Tableau, or a similar tool)

  • Familiarity with data quality frameworks and automated testing approaches
  • Understanding of data engineering concepts (pipelines, orchestration, version control)
  • Exposure to working in a product-oriented or data platform environment

All of our opportunities require that applicants are eligible to work in the specified country/location, unless otherwise stated in the job description.

Whitehall Resources are an equal opportunities employer who value a diverse and inclusive working environment. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity or expression, sexual orientation, national origin, pregnancy, disability, age, veteran status, or other characteristics.

Apply Now

    Your IT Specialist

    Jack Urwin
    Principal Consultant | Key Accounts Contract Team

    View similar job roles

    Job ID: BBBH68025_1787310070
    Contract

    SAP MTD/EWM/IM Consultant

    India
    Job ID: BBBH68019_1787241459
    Contract

    MES Consultant (Siemens Opcenter)

    Sweden
    Job ID: BBBH67970_1787067761
    Hybrid
    Permanent

    NOC Engineer – Linux

    Hybrid-remote in Bristol

    Promote Your Vacancy

    Upload your open role and expand your company's reach instantly.

    Upload a job

    Register your CV with us

    If you are a prospective candidate and would like to register your details with us

    Upload your CV

    I would like to thank you very much for 2 years of cooperation with me and my company

    I have always found their consultants to be professional, knowledgeable, and most importantly, deliver to all agreed timelines, despite challenging circumstances.

    Whitehall are responsive, flexible and propose high quality candidates that fit within our budgets and project timelines

    The attitude, the relationship and the quality of the services definitely makes you guys different from other suppliers

    They always stayed close to us to make sure all needs were captured, and we were thinking ahead

    The candidates are always excellently suited to the position and are secured at rates which are lower than the market average

    The process was made simple by George who understood both needs of the clients

    Tomasz was knowledgeable about the market and did a thorough job of gathering information about the role before he began the search

    The efficiency and speed to deliver is brilliant

    Whitehall provides various services and resources to make the transition from interview to onboarding as smooth as possible

    Our collaboration with Whitehall Resources has proven to be instrumental in addressing our global SAP consultant resourcing needs