Job Tittle: Databricks Engineer with AEP (Adobe Experience Platform)
Location: Louisville, Kentucky
Duration: 12+ Months
Job Type: Long Term Contract
Job Description:- Overall 10+ Years of experience
- We are seeking a skilled Databricks Engineer with Adobe Experience Platform (AEP) expertise to design, develop, and optimize large-scale data pipelines and integrations.
- The candidate will play a key role in enabling real-time analytics, customer data management, and seamless integration between AEP and enterprise data platforms.
Key Responsibilities:- Design and build ETL/ELT pipelines on Databricks to process and transform structured, semi-structured, and unstructured data.
- Integrate Databricks with AEP for data ingestion, identity resolution, and audience activation.
- Enable data flows between cloud data platforms (Azure/AWS/GCP) and AEP.
- Work closely with AEP architects and marketing teams to enable customer 360 views and personalization use cases.
- Optimize Spark jobs, data models, and ensure scalability and performance.
- Implement best practices for data quality, governance, and compliance (HIPAA, GDPR, CCPA).
- Collaborate with cross-functional teams to support real-time analytics and customer journey orchestration.
Essential Skills:- Strong expertise in Databricks, Apache Spark, PySpark, and distributed data processing.
- Hands-on experience with Adobe Experience Platform (AEP) RT-CDP, data ingestion, schemas, and audience segmentation.
- Strong knowledge of Azure Data Services (Azure Data Lake, Azure Synapse, Azure Data Factory) or equivalent cloud services.
- Experience with data modeling, SQL, JSON, and APIs.
- Familiarity with CI/CD pipelines, Git, and DevOps practices.
- Experience (Years): 6 10 (with at least 2 3 years in Databricks and 1 2 years in AEP)
Desirable Skills:- Experience with Adobe Analytics, Adobe Target, or Journey Orchestration.
- Knowledge of machine learning workflows in Databricks (ML Flow, Delta Lake).
- Healthcare or insurance industry experience.
Must-Have Skills:- Databricks + Spark/PySpark expertise.
- Strong hands-on with AEP (Real-Time CDP, integrations).
- Cloud data engineering (preferably Azure).
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.