Data Infrastructure Engineer

This position is for a hands-on Developer in the Distributed Data Development team of the North America based Credit Risk Technology group. The successful candidate will have an opportunity to work closely with the Credit Risk business unit, IT business analysts, GUI development teams and Data providers and consumers to deliver Credit Risk Data Warehouse systems related projects. The candidate must have minimum 10 years hands-on IT experience, preferably in the financial services industry working on all aspects of SDLC with focus on large volume data processing applying complex business rules, performing transformation, aggregation and designing data persistence model for Transactional Data Processing (OLTP) as well as Data Warehouse. Must have strong ability to work on multiple IT projects simultaneously, working with the stake holders, clients and other system owners to drive the projects to successful completion. Must have previous involvement in data modeling and/or systems architecture. Responsibilities will include technical analysis, design, development and perform enhancements.

The candidate will participate in all of the following activities: - 

-Hands-on development experience working with large data volumes, building distributed processing using Java or Python on Spark, data frames, externalizing business rules etc.

-Strong knowledge of database table partitions, data distribution, parallel loads and extracts working on DB2 DPF or Greenplum or other big data technologies

-Build batch vs. event driven data processing. Design for high level of concurrency to ensure data integrity without compromising performance

-Working in a agile squad as a contributor, working with other developers towards a common goal

-Modeling and implementing database schemas

-Coming up with system architecture/re-design proposals for greater efficiency and ease of maintenance and developing software to turn proposals into implementations

Skills Required:

-Strong hands-on knowledge of Python or Java as a distributed data developer, working on large data volumes (20m+ rows per day)

-Ability to deliver multiple simultaneous projects under pressure of regulatory driven deadlines

-10+ years of relational database experience with emphasis on data processing as described above

-Hands-on experience with Greenplum / DB2 / Teradata / Oracle

-Excellent analytical ability

-Strong collaboration and communication skills

Skills Desired : 

-Credit risk knowledge

-Job scheduler knowledge

-Autosys