Big Data Engineer

Software Guidance & Assistance

Rockville, MD

Apply

JOB DETAILS

SALARY

$73–$75 Per Hour

SKILLS

AWS Lambda, Amazon Elastic Compute Cloud (EC2), Amazon Web Services (AWS), Applications Security, Artificial Intelligence (AI), Automation, Bash Scripting, Big Data, Business Continuity Planning (BCP), Business Operations, CA Workload Automation AE (AutoSys Edition), CPU (Central Processing Unit), Change Management, Cloud Applications, Cloud Computing, Communication Skills, Computer Maintenance, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Customer Support/Service, Data Processing, Data Recovery, DevOps, Disaster Recovery, Documentation Plan, Genetics, Git, Incident Management, Information Technology & Information Systems, Jenkins, Linux Operating System, Memory Hardware, Metrics, Microsoft Active Directory, Microsoft Windows Azure, Microsoft Windows Operating System, Microsoft Windows Server, Microsoft Windows System Administration, Network Operations Center, Operating Systems, Organizational Skills, Performance Analysis, Performance Tuning/Optimization, PostgreSQL, Presentation/Verbal Skills, Problem Solving Skills, Procedure Implementation, Process Analysis, Process Improvement, Production Systems, Python Programming/Scripting Language, Quality Management, Quality Metrics, Regulations, SQL (Structured Query Language), Sarbanes-Oxley Act (SOX), Schedule Development, Scripting (Scripting Languages), Server Hardware, Server Maintenance, Software Administration, Software Debugging, Software Development, Software Patches, Staff Development, Standards Development, Systems Administration/Management, Systems Analysis, Technical Support, Test Plan/Schedule, Unix Operating Systems, Virtual Machine (VM), Windows PowerShell, Workload Automation, Writing Skills

LOCATION

Rockville, MD

POSTED

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in the DMV area.

This position is for a mid-level support engineer that will provide primarily support of Big data operations in AWS for Market Regulation. Supported platforms include AWS Services, UNIX, Windows, SQL, Postgres, Batch Scheduling, etc... Additionally should work under minimal supervision to maintain enterprise Linux infrastructure across on-premises data centers and cloud environments. This role combines traditional systems administration with modern DevOps practices, leveraging containerization technologies, cloud platforms (AWS & Azure), and AI-powered tools to ensure FINRA Infrastructure meets defined quality standards while driving operational excellence and innovation.

Responsibilities :

Big data operations activities for AWS services in support of the processing of market volumes of big data. Work involves monitoring batch processing, data processing execution, SQL status queries, management / remediation of issues, and escalation activities.
Work also includes automation of data monitoring using Python scripting and SQL queries. Usage of central batch processing tools like JAMS or any other equivalent is valuable to have. Scripting experience is required, and mid-level knowledge of Python and PowerShell is desired. FINRA has a very mature automated deployment pipeline for deploying applications through their development lifecycles.
SQL, Postgres, Oracle, or equivalent database experience and building/running queries is a must.
Review and analyze process and system specifications to ensure delivery requirements are met across hybrid Linux and Windows environments.
Operate cloud infrastructure solutions on AWS (EC2, ECS, Lambda, CloudWatch, IAM) and Azure (Virtual Machines, Container Instances, Monitor, Active Directory)
Ensure the Company's Reliability, Availability and Serviceability (RAS) metrics are sustained and improved through proactive monitoring, automation, and continuous optimization across hybrid environments.
Document test plans as well as create/revise and execute Bash, Python, or other scripting languages for automation and infrastructure-as-code implementations.
Proficiency in Workload Automation Scheduler and ability to Implement and manage batch schedules using software such as JAMS/Broadcom AutoSys
Monitor system performance and resolve scheduling conflicts or failed job as well as implement change management procedures for Job scheduling
Implements and updates monitoring tools for Linux systems, containerized applications, and cloud resources using industry-leading platforms and AI-enhanced observability solutions.
Monitors operating system and cloud infrastructure performance to achieve optimum performance levels, checking system logs, analyzing CPU/memory/IO usage, and using performance monitoring tools to detect and resolve bottlenecks.
Proficiency in Operating System & Software Debugging, experienced-level troubleshooting of Windows Server and/or Linux operating systems, including patching, application deployment, and server hardware maintenance.
Proficiency in CI/CD pipeline tools such as Jenkins and GitLab with good understanding of git branching strategies, deployment pipelines and performances and ability to identify and resolve deployment failures.
Interface with other team members and other teams to ensure technology solutions and staff are aligned with customer expectations and overall technology vision, including DevOps, Security, and Application Development teams.
Lead/Co-lead internal process improvement initiatives focused on automation, containerization, and AI adoption. Provide feedback on processes by offering suggestions.
Participate in periodic Disaster Recovery (DR), Business Continuity Planning (BCP) and Sarbanes Oxley (SOX) testing and reporting, including validation of backup/recovery procedures for Linux systems, containerized applications, and cloud resources.

Required Skills :

Bachelor's degree in Computer Science, Information Systems or related discipline with at least five (5) years of related experience, or equivalent training and / or work experience.
Past senior level systems administrator experience in a production environment.
Knowledge of industry leading monitoring and diagnostic tools
Knowledge of at least one operating system and at least one contemporary scripting language.
Knowledge of communication and network technologies.
Exposure to common operational practices like metrics reporting, change management, incident management, problem management and communication
Strong written and verbal technical communication skills.
Demonstrated ability to develop effective working relationships that improved the quality of work products.
Should be well organized, thorough, and able to handle competing priorities.
Ability to maintain focus and develop proficiency in new skills rapidly.
Ability to work in a fast paced environment.
Ability to working well under pressure

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/ .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

About the Company

Software Guidance & Assistance

Resume Resources

Free Resume Templates Free Resume Builder