Mandatory Skills: Data Engineer with experience on Palantir
Palantir Data Engineer
We are seeking a highly skilled Palantir Data Engineer to design, develop, and optimize data solutions using Palantir Foundry, ensuring seamless data integration, transformation, and analysis. The ideal candidate will have experience with Palantir's platforms, a strong background in data engineering, and expertise in implementing robust and scalable data workflows.
Key Responsibilities:
Data Integration Transformation:
- Design and implement ETL pipelines in Palantir Foundry to handle diverse data sources, ensuring high data quality and consistency.
- Optimize and enhance data workflows to improve performance and scalability.
Data Modeling Architecture:
- Develop data models, ontology, and schemas that align with business requirements.
- Implement robust data governance and lineage mechanisms within the Palantir ecosystem.
Maintenance & Monitoring:
- Monitor data pipelines, troubleshoot issues, and ensure uninterrupted data operations.
- Maintain documentation for workflows, schemas, and integration processes.
Continuous Improvement:
- Drive innovation by leveraging the latest Palantir Foundry features and industry best practices.
- Automate repetitive processes to enhance operational efficiency
Required Skills & Experience:
Proficiency in Palantir Foundry: Hands-on experience in developing and managing pipelines, workflows, and applications on the Palantir Foundry platform.
Data Engineering Expertise:
- Strong programming skills in Python, Java, or Scala for data manipulation and pipeline creation.
- Proficiency in SQL and database technologies (e.g., PostgreSQL, MySQL, or Oracle).
- Experience in data modeling, ontology design, and implementing data governance.
Cloud & Big Data Ecosystems: : Familiarity with AWS, Azure, or GCP and Big Data tools (e.g., Spark, Hadoop).
Experience with APIs for data integration