Amazon Web Services (AWS), Apache Cassandra, Data Management, Database Extract Transform and Load (ETL), NoSQL, Python Programming/Scripting Language, SOLR, SQL (Structured Query Language), Software Engineering
Job title: Data Engineer/Python developer
Location: Austin, TX
Duration: 12+ months
In this role, person will be:
- Creating/maintaining Batch (Spark) and Stream (Flink) jobs. Involved Technologies Kafka, Iceberg, Cassandra, SOLR
- Manage Data platform infra - Airflow, EKS, Superset, Trino
Skills required:- 5-10 yrs Data Engineer
- 5-10 yrs Python Developer
- Creating/Maintaining large scale Batch data management
- Spark
- ETL
- Streams
- Flink
- Kafka
- Iceberg
- NoSQL
- Cassandra
- Solr
- Manage Data Platform Infrastructure
- Airfflow
- AWS EKS
- Superset
- Trino
- Pandas
- Numpy
- Scikit Learn
- SQL programming
- GenAI capabilities