Big Data Infrastructure Engineer

Job OverviewWe are seeking a Big Data Infrastructure Engineer with a strong AI-first and automation-driven mindset to join ourinfrastructure team and support the administration and operation of enterprise Big Data platforms and their underlyinginfrastructure.The ideal candidate should have strong hands-on experience in Linux operating system administration and databaseadministration, with particular focus on configuration, troubleshooting, performance tuning, optimization, monitoring,and production support.The candidate is expected to actively leverage AI-assisted tools and automation to improve troubleshooting,operational efficiency, scripting, documentation, research, and day-to-day engineering activities, while maintainingthe technical judgment required to validate solutions before implementation.The role also requires practical knowledge of Docker and Kubernetes, along with a good understanding of clustering,high availability, distributed systems, and Big Data concepts. A strong willingness to continuously learn and staycurrent with emerging AI, automation, infrastructure, and Big Data technologies is essential.Duties and Responsibilities• Leverage AI-assisted tools to improve troubleshooting, log analysis, scripting, documentation, research, andoperational efficiency while validating outputs before implementation.• Identify repetitive operational activities and develop automation solutions using Shell/Bash, Python, Ansible,APIs, or other appropriate technologies.• Continuously evaluate emerging AI and automation capabilities and identify practical opportunities to improveinfrastructure operations and engineering workflows.• Administer, configure, manage, troubleshoot, and optimize Linux operating systems supporting production andnon-production environments.• Monitor and analyze CPU, memory, disk, filesystem, network, processes, and system services, and performconfiguration and performance tuning when required.• Administer and manage PostgreSQL, MySQL/MariaDB, and Redis, including configuration, access management,backup and recovery, monitoring, troubleshooting, maintenance, and performance optimization.• Support database replication, high availability, backup/recovery, and capacity management requirements.• Support and maintain Docker and Kubernetes environments, including deployment, configuration, monitoring,troubleshooting, scaling, and cluster administration.• Support clustered and distributed platforms with focus on high availability, replication, failover, loadbalancing, quorum, capacity management, and disaster recovery.• Support the installation, configuration, monitoring, administration, and upgrade of Cloudera/Hortonworks andHadoop-based environments.• Support and troubleshoot Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, HBase, andKafka, as well as related platforms such as Airflow, Superset, and Trino/Presto where applicable.• Perform production monitoring and support using tools such as Zabbix and Grafana, and participate in incidentmanagement, root cause analysis, and corrective/preventive actions.• Support security integrations and technologies such as Ranger, LDAP, and Kerberos.• Collaborate with development, infrastructure, and other technical teams on deployments, upgrades,infrastructure changes, troubleshooting, and production support.• Maintain technical documentation, operational procedures, automation, and infrastructure configuration records.Skills and Qualifications• 3-5 years of relevant hands-on experience in Linux/System Administration, Database Administration, Big DataInfrastructure, DevOps, or a related infrastructure role.• Bachelors Degree in Computer Science, Computer Engineering, Information Technology, or a related field.• Strong AI-first and automation-driven mindset, with demonstrated ability to use AI-assisted tools effectively intechnical workflows and critically validate generated recommendations before applying them.Big Data Infrastructure Engineer - Job DescriptionGood scripting and automation skills using Shell/Bash; knowledge of Python, Ansible, APIs, or similartechnologies is highly desirable.• Strong hands-on knowledge of Linux administration, including system configuration, service management,resource management, storage/filesystems, permissions, networking, troubleshooting, and performanceoptimization.• Good hands-on knowledge of PostgreSQL, MySQL/MariaDB, and Redis administration, including configuration,backup and recovery, users and privileges, monitoring, maintenance, and performance tuning.• Good understanding of database concepts including connections, transactions, locks, indexing, queryperformance, replication, and high availability.• Good hands-on understanding of Docker and Kubernetes, including containers, images, pods, deployments,services, storage, networking, monitoring, resource management, and troubleshooting.• Good understanding of clustering and distributed system concepts, including high availability, replication,failover, load balancing, and quorum.• Good understanding of networking fundamentals, including TCP/IP, DNS, ports, routing, connectivity, andnetwork troubleshooting.• Good understanding of Big Data concepts and the Hadoop ecosystem, with familiarity or hands-on experiencein HDFS, YARN, Hive, Spark, Kafka, and HBase.• Familiarity with Cloudera or Hortonworks platforms is highly desirable.• Familiarity with Zabbix/Grafana, Ranger/LDAP/Kerberos, CI/CD tools, and Trino/Presto is an advantage.• Strong troubleshooting, analytical, and problem-solving skills, with the ability to investigate issuessystematically and identify root causes.• Ability to work effectively in production environments, collaborate across technical teams, take ownership ofassigned activities, and continuously develop technical knowledge.Preferred Certifications• Relevant Linux certifications such as RHCSA or RHCE.• Kubernetes certification such as CKA.• PostgreSQL or MySQL-related certifications/training.• Red Hat Ansible or other relevant automation certifications.Note: Certifications are considered an advantage and are not a substitute for practical hands-on experience.