Sr. Data Developer

InterSources Inc.

Albany, NY

JOB DETAILS
SKILLS
Application Programming Interface (API), Centers for Disease Control and Prevention (CDC), Cloud Architecture, Cloud Computing, Cross-Functional, Data Analysis, Data Warehousing, Database Programming, Enterprise Architecture, Enterprise Data Integration, Error Handling, Git, Hubs, Informatica, Information/Data Security (InfoSec), Leadership, Machine Tool, Metadata, NoSQL, OAuth, Performance Tuning/Optimization, Problem Solving Skills, REST (Representational State Transfer), Requirements Management, SOAP (Simple Object Access Protocol), SQL Databases, Security Assertion Markup Language (SAML), Source Code/Configuration Management (SCM), Standards Development, User Documentation
LOCATION
Albany, NY
POSTED
30+ days ago
Required: Sr. Data Developer
Hybrid
Interview: Webex
Designated Work Location: 40 North Pearl, Albany NY
Duration: 14 months

Mandatory Qualifications:
  • Level III- More than seven (7) years of experience working on complex projects with 2 or more years in a leadership role as a Developer
  • More than seven(7) years of experience in designing end-to-end architecture for an enterprise Data Integration hub for centralized data ingestion and transformation for various ingestion patterns(batch and
event-driven)
  • More than (7) years proven experience with SQL/NoSQL databases, API development (REST/SOAP), version control (Git), and building data integrations between on-premises & cloud systems

Desirable Qualifications:
  • More than (7) years proven experience with standardizing Api consumption, error handling, re-tires, and throttling.
  • More than (7) years of experience in managing schema evolution and backward compatibility supporting legacy transformations
  • More than (7) years' hands-on experience in designing and implementing data integration hub
  • More than (7) years proven experience in complex API based workflows, data governance, metadata and lineage tooling
  • More than (7) years of experience in integrating Informatica with Databricks as the hubs' transformation and curation engine More than (7) years of experience in designing hub-based data
publishing mechanisms for data warehouses and analytics
  • More than (7) years proven experience with security standards (OAuth, SAML), data governance, performance tuning, and relevant cloud/integration certifications
  • More than seven(7) years of experience in event streaming platforms and cloud integration architectures

Duties/Responsibilities:
Design and Develop Service based data integration architectures.
Build ELT pipelines with Databricks using PySpark and Databricks SQLImplement batch and incremental data loads, including CDC patterns.
Create reusable, standardized integration patterns.
Establish logical and physical integration layers, curation and distribution.
Working with cross-functional teams (developers, product managers, etc.) to define integration requirements and ensure successful integration.
Identifying and resolving integration related issues, optimizing performance, and ensuring data security.
Creating and maintaining clear and comprehensive documentation for internal users and stakeholders

About the Company

I

InterSources Inc.

It’s all about harnessing the real power of data. InterSources Inc was founded in 2007 providing intelligent data solutions to clients across industries and geographies.

Over the years, we have built products on Business Intelligence & Big Data platform simplifying and transforming the way business intelligence and real-time data analytics empower Corporations and end-users using Softwares like Tableau, Business Objects, MicroStrategy, etc.

In the process, we have enabled companies to use data analytics to help better understand, predict and influence consumer behavior, identify new market opportunities as they emerge, provide to users the data they need, alert the user when and why key business metrics have changed and enable them to make smart decisions.

COMPANY SIZE
100 to 499 employees
INDUSTRY
Computer/IT Services
FOUNDED
2007
WEBSITE
https://www.intersourcesinc.com/