Data Engineer

Axelon Services Corporation

Irving, TX

JOB DETAILS
SALARY
$77–$82 Per Hour
JOB TYPE
Full-time
SKILLS
Agile Programming Methodologies, Algorithms, Analysis Skills, Android, Apache, Apache Cassandra, Apache Kafka, Apple iPhone, Application Programming Interface (API), Architectural Services, Artificial Intelligence (AI), Best Practices, Big Data, Blueprints, Business Analysis, Business Processes, Business Strategy, Business Support, Cloudera, Coaching, Code Reviews, Communication Skills, Computer Programming, Concurrency, Consulting, Continuous Improvement, Cross-Functional, Data Analysis, Data Management, Data Modeling, Data Quality, Data Science, Data Structures, Data Visualization Tools, Data Warehousing, Database Extract Transform and Load (ETL), Debugging Skills, Design Patterns Programming Methodologies, Docker, Ecosystems, Financial Services, Git, Global Financial Markets, Hibernate, Identify Issues, Industry Standards, Information/Data Security (InfoSec), Interpersonal Skills, JAX (Java API for XML), JAXB (Java Architecture for XML Binding), JUnit, Java, Java Message Service (JMS), Java Persistence API (JPA), Leadership, Linux Operating System, Machine Learning, Maintain Compliance, Mentoring, Microservices, Model View Controller, MongoDB, Multithreaded Programming, MySQL, NoSQL, Open Source, Operational Improvement, Parallel Computing, People Management, Performance Analysis, Performance Tuning/Optimization, PostgreSQL, Power BI, Problem Solving Skills, Process Analysis, Process Improvement, Programming Tools, Project/Program Management, Python Programming/Scripting Language, REST (Representational State Transfer), React.js, Regulatory Compliance, Relational Databases (RDBMS), Remote Access, Risk Management, SQL (Structured Query Language), SQL Databases, Software Design, Software Engineering, Source Code/Configuration Management (SCM), Spring Framework, System Architecture, Systems Analysis, Tableau, Talent Management, Team Player, Technical Analysis, Technical Consulting, Technical Leadership, Technical Strategy, Test Driven Development (TDD), Testing, Time Management, Work From Home
LOCATION
Irving, TX
POSTED
Today
Global Financial Firm located in IRVING, TX has an immediate contract opportunity for an experienced Data Engineer "This role is currently on a Hybrid Schedule. You will need to have reliable internet, computer and android or iphone for remote access into the client systems during remote work. We will be expected in the office weekly 3 days depending on the team requirement. ****Video/ f2f interviews are required prior to all offers. Pay rate range: $77.00 - $82.00 Negotiable based upon years of experience Job Description: As a key member of our global development team, you will: Innovate & Develop: o Partner closely with project managers, business stakeholders, and senior managers to translate complex business requirements into well-architected technical solutions. Consult with users and other technology groups, providing advanced programming insights and support. o Drive cross-functional collaboration with diverse management teams to ensure seamless integration of functions, aligning efforts to achieve strategic organizational goals. o Proactively identify, define, and implement necessary system enhancements to facilitate the successful deployment of new products and process improvements. Complex Problem Resolution: o Lead the resolution of high-impact problems and critical projects through in-depth evaluation of intricate business processes, complex system architectures, and relevant industry standards. o Employ advanced analytical and interpretive thinking to define issues, uncover root causes, and develop innovative, sustainable solutions. o Consult with users, clients, and other technology groups on issues, and recommend programming solutions. Analyze complex technical and business challenges, and propose innovative solutions that enhance system functionality and business processes. Technical Architecture & Standards Leadership: o Serve as a subject matter expert in application programming, ensuring that all application designs rigorously adhere to the overall architectural blueprint and strategic technology roadmap. o Leverage an advanced understanding of system flow to develop and enforce robust standards for coding, testing, debugging, and implementation across development teams. Mentorship & Talent Development: o Act as a trusted advisor and coach for mid-level developers and analysts, providing guidance, fostering skill development, and judiciously allocating work to maximize team potential and project success. o Provide technical guidance, mentorship, and code reviews to junior data engineers, fostering a culture of excellence and continuous improvement. Operational Excellence: Ensure adherence to best practices and essential procedures. Autonomy & Ownership: Operate with a high degree of independence and judgment, taking ownership of critical initiatives and driving them to successful completion. Risk Management: Proactively assess and manage technical risks, demonstrating a strong commitment to regulatory compliance, ethical judgment, and transparent reporting of control issues. Design, develop, and maintain robust, scalable, and high-performance data pipelines using PySpark. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and tune Spark jobs for performance and efficiency. Implement data quality checks and ensure data integrity across all data pipelines. Data Architecture & Design: Design, develop, and optimize data architectures, pipelines, and data models to support various business needs, including analytics, reporting, and machine learning. ETL/ELT Development (Python/PySpark Focus): Build, test, and deploy highly scalable and efficient ETL/ELT processes using Python and PySpark to ingest, transform, and load data from diverse sources into data warehouses and data lakes. Develop and optimize complex data transformations using PySpark. Data Quality & Governance: Implement best practices for data quality, data governance, and data security to ensure the integrity, reliability, and privacy of our data assets. Performance Optimization: Monitor, troubleshoot, and optimize data pipeline performance, ensuring data availability and timely delivery, particularly for PySpark jobs. Qualifications: We are seeking a talented individual with: Experience: 6-10 years of progressive experience in systems analysis and programming of software applications, with a proven track record of implementing successful projects. Technical Expertise : o Strong proficiency in Java application technologies, including deep experience with TDD (Test-Driven Development), Spring framework, and Microservices architecture. o Extensive hands-on experience with PySpark and advanced Python programming skills. o Proven experience with Big Data ecosystems, including Cloudera and/or Data Bricks. o Hands-on experience with distributed query engines like Starburst (Trino/Presto). o Proficient in designing and managing complex workflows using scheduling tools, particularly Apache Airflow. o Strong expertise in SQL and experience with relational and non-relational databases o Excellent knowledge of algorithms and data structures, design patterns. Experience in systems analysis and programming of software applications o Strong Java experience : Java core, collections, concurrency, streams o Frameworks and APIs: Spring (Core, Batch, Integration, MVC, Boot, Data), Hibernate, Jackson , JAX RS, JPA, JAXB o Experience with distributed caches like Apache Gem fire will be a plus o Messaging: JMS, Kafka o Experience in Angular 21+ / ReactJS o Testing: JUnit, Mocking frameworks (Mockito, Power Mock) o Experience in performance enhancements using parallel processing, multithreading. Understanding locking/synchronization o Understanding Docker and Kubernetes o Experience in RESTful API development and integration, deployment framework and source control experience such as Git. o Solid understanding and experience with SQL. o Proficiency in Linux environments. o Experience with job scheduling. Methodology: Working knowledge of project management techniques and methods, with a focus on agile methodologies. Adaptability: Ability to thrive in a fast-paced environment, manage multiple deadlines, and adapt quickly to evolving requirements and priorities. Collaboration: A strong team player with excellent communication skills, capable of working effectively with global teams to deliver integrated solution Experience with real-time data streaming and processing using PySpark Structured Streaming. Knowledge of machine learning concepts and MLOps practices, especially integrating ML workflows with PySpark. Familiarity with data visualization tools (e.g., Tableau, Power BI). Contributions to open-source data projects. Strong experience with SQL and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Cassandra). Preferred: Experience with AI development tools (eg. Copilot, Devin & Claude) Prior experience or a keen interest in the financial services industry Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements Experience of working in fast paced environment Flexible and adaptive, team player Excellent analytical and communication, interpersonal skills.

About the Company

A

Axelon Services Corporation