Data Engineer
Oakland, CA (Hybrid - 1 day onsite per week)
12 months
Position Overview
We are seeking an experienced Palantir Foundry Data Engineer to design and develop scalable data pipelines, data products, and operational solutions using Palantir Foundry, PySpark, Python, SQL, and TypeScript.
The ideal candidate will have strong hands-on experience with Foundry Ontology, real-time/streaming data processing, Contour, APIs, and enterprise data integration.
Experience in the Energy & Utilities industry is highly preferred.
Key Responsibilities
- Design and develop end-to-end data pipelines using Palantir Foundry, PySpark, Python, and SQL.
- Build and maintain Foundry Ontology models, including object types, properties, relationships, and actions.
- Develop real-time and near-real-time streaming pipelines for operational and event-driven data.
- Build business and integration logic using TypeScript and APIs.
- Develop analytical workflows and data exploration solutions using Foundry Contour.
- Convert complex SQL, stored procedures, triggers, ETL mappings, and business rules into scalable Foundry/PySpark solutions.
- Implement data-quality checks, schema validation, lineage, metadata management, monitoring, and health checks.
- Design reusable frameworks and optimize pipelines for performance, scalability, and reliability.
- Follow production-grade engineering practices, including Git, CI/CD, unit testing, integration testing, and code reviews.
- Collaborate with architects, business SMEs, product owners, and engineering teams in an Agile/Scrum environment.
Required Skills
- Palantir Foundry Core Concepts
- Foundry Ontology
- PySpark, Python, and SQL
- TypeScript
- Foundry Contour
- Spark Streaming / Real-Time Data Processing
- REST APIs and enterprise integrations
- Data modeling and large-scale ETL/ELT
- Data quality, metadata, and lineage
- Git and CI/CD
- Production-grade software engineering and testing
Qualifications
- 10-15+ years of overall IT/data engineering experience.
- 5+ years of hands-on data engineering/ETL experience.
- Strong experience building large-scale, production-grade data solutions.
- Experience with cloud and distributed data-processing environments.
- Bachelor's/Master's degree or equivalent experience in Computer Science, Engineering, MIS, or a related field.
Preferred Qualifications
- Palantir Foundry Data Engineer Certification.
- Experience with Ontology modeling, TypeScript, Contour, Foundry APIs, and streaming architectures.
- AWS experience is a plus.
Preferred Industry Experience
Energy & Utilities domain experience involving the following areas is highly desirable:
- Outage Management
- ADMS/OMS
- Grid Operations
- ETOR
- PSPS
- Customer Communications
|