Data Engineer

We are seeking an experienced Data Engineer with strong, hands‑on expertise in Palantir Foundry to design, build, and optimize scalable data pipelines, semantic models, and data products. In this role, you will work closely with data scientists, analysts, product teams, and business stakeholders to deliver robust, production‑grade data foundations that support analytics, automation, and operational decision‑making. You will play a key part in shaping our data ecosystem, ensuring reliability, performance, and long‑term sustainability.

Key Responsibilities

• Design, develop, and maintain end‑to‑end data pipelines using Palantir Foundry (Pipeline Builder, Code Repositories, Data Lineage, Ontology, Workshop, Quiver, etc.).
• Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production‑ready components.
• Build and maintain high‑quality, version‑controlled data products aligned to business use cases.
• Work with federated data environments, handling diverse sources and complex integration requirements.

• Design, extend, and maintain Foundry ontologies, including object types, link types, property types, and semantic relationships.
• Build semantic layers that support analytics, operational workflows, and machine learning use cases.
• Embed strong data quality principles through validation checks, lineage tracking, and governance frameworks.

• Monitor pipeline performance and optimize for scalability, cost efficiency, and speed.
• Implement automated testing, CI/CD patterns, and deployment best practices for Foundry-based data assets.
• Troubleshoot production issues, ensure root‑cause analysis, and drive long-term fixes.

• Translate ambiguous business requirements into scalable data engineering solutions.
• Support Foundry Workshop apps, dashboards, and end‑user analytical experiences.
• Communicate clearly with technical and non‑technical stakeholders, ensuring shared understanding of data design and pipeline behavior.

Required Qualifications

• Bachelor’s or master’s degree in computer science, Engineering, Information Systems, or related field.
• 5+ years of experience in data engineering (or 3+ years with strong Foundry depth).
• Proven, hands‑on experience working with Palantir Foundry in a production environment.
• Strong proficiency in Python, SQL, PySpark and Spark SQL
• Experience delivering production pipelines in AWS, Azure, or GCP environments.
• Solid understanding of data modeling, schema design, metadata management, and governance.
• Familiarity with CI/CD, Git‑based workflows, and software engineering best practices.

Thank you for your interest in this role. Please also share your CV at Shyam@lsarecruit.co.uk and if suitable, we will get in touch with you to discuss further.