Want to know if you’re a fit? Upload your resume and let our AI show you.
Skills
Access Controlunmatched
Amazon Web Services (AWS)unmatched
Apacheunmatched
Apache Sparkunmatched
Artificial Intelligence (AI)unmatched
Asset Managementunmatched
Best Practicesunmatched
Cataloguingunmatched
Cloud Computingunmatched
Continuous Deployment/Deliveryunmatched
Continuous Integrationunmatched
Customer Support/Serviceunmatched
Data Analysisunmatched
Data Managementunmatched
Data Modelingunmatched
Data Processingunmatched
Data Qualityunmatched
Data Setsunmatched
Data Warehousingunmatched
Database Extract Transform and Load (ETL)unmatched
Dimensional Modelingunmatched
Documentationunmatched
Gitunmatched
Investment Reportingunmatched
Microsoft Windows Azureunmatched
Multiplatform/Cross-Platformunmatched
Operational Auditunmatched
Performance Tuning/Optimizationunmatched
Python Programming/Scripting Languageunmatched
Quality Monitoringunmatched
Query Optimizationunmatched
SQL (Structured Query Language)unmatched
Scalable System Developmentunmatched
Snowflake Schemaunmatched
Software Engineeringunmatched
Star Schemaunmatched
Stock Marketunmatched
Structured Dataunmatched
Testingunmatched
Training Data Setsunmatched
Transformation Toolsunmatched
Unstructured Dataunmatched
Workflow Analysisunmatched
Description
Our Client, a leading Asset Management firm located in Midtown, Manhattan seeking a full time Data Engineer. The Senior Data Engineer will design and scale the data infrastructure supporting my clients private equity and private debt strategies. This is a hybrid role (3 days onsite).
This role sits at the intersection of data engineering and investment operations. The right candidate will work directly with fund administration, operations, and analytics teams to model, move, and govern data across a complex, multi-administrator environment spanning multiple fund structures and jurisdictions. Our data landscape is operationally driven and non-standard by nature, sourced from GP notices, fund administrators, data rooms, and bespoke operational workflows rather than exchange feeds or market data vendors. We need someone who understands that distinction and can build for it.
RESPONSIBILITIES
Develop and optimize data models in the data warehouse for analytics, reporting, and operational workloads — translating private markets workflows such as capital calls, distributions, and co-investment closings into well-governed, reusable datasets
Design, build, and maintain scalable ETL/ELT data pipelines that ingest and normalize large volumes of structured and unstructured data from multiple fund administrators with inconsistent booking conventions across diverse fund structures and jurisdictions
Implement data quality checks, monitoring, and alerting to ensure the reliability and accuracy of data across the platform.
Collaborate with users and development teams to understand data requirements and deliver well-modeled, accessible datasets.
Optimize query performance, pipeline throughput, and storage costs across the data platform.
Contribute to data governance practices including documentation, lineage tracking, cataloging, and access controls — with a focus on golden record ownership and how upstream data quality propagates through downstream investment and reporting systems
Leverage AI to drive efficient coding and process design
QUALIFICATIONS
Demonstrated fluency with AI tools — co-pilot tools, LLM-assisted development, or AI-augmented data workflows
Advanced SQL skills and experience designing dimensional data models (star schema, snowflake schema).
Proficiency in Python and experience with data processing frameworks such as Apache Spark, Pandas, or Polars.
Hands-on experience with orchestration tools such as Apache Airflow
Experience with Snowflake and cloud services (AWS or Azure).
Familiarity with data transformation tools like dbt and version-controlled analytics workflows.
Solid understanding of software engineering best practices including Git, CI/CD, testing, and containerization.
Preferred Qualifications
Experience with streaming data architecture using Kafka
Experience implementing data contracts and schema evolution strategies.
Experience with OpenShift platform
Experience normalizing data across similar data sets
Experience private markets data context
Financial markets data domain experience required with Private Markets data experience a plus