We have following urgent role with our DIRECT clientTitle: Sr. Big Data EngineerLocation: Sunnyvale, CA Duration: 6+ Months Rate: Market
As part of the International eCommerce Data Engineering team, you'll be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You'll interact with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions. Essential Job Functions & Responsibilities :
Min 6-8 years of Big data development experience
Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development
Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
Experience with Java, Python to write data pipelines and data processing layers
Experience in writing map-reduce jobs
Demonstrates expertise in writing complex, highly-optimized queries across large data sets
Proven, working expertise with Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark, just to name a few
Highly Proficient in SQL
Experience with Cloud Technologies ( GCP, Azure)
Experience with Relational, NoSQL/in memory data stores would be a big plus ( Oracle, Cassandra, Druid)
Provides and supports the implementation and operations of the data pipelines and analytical solutions
Performance tuning experience of systems working with large data sets
Experience with clickstream data processing
Experience with Data Governance ( Data Quality, Metadata Management, Security, etc.)
Experience in developing RESTful API data service
Retail experience is huge plus
Numbers & Facts
Location
Sunnyvale, California
Skills
Apache Cassandraunmatched
Apache Hadoopunmatched
Apache Hiveunmatched
Apache Sparkunmatched
Application Programming Interface (API)unmatched
Big Dataunmatched
Business Intelligenceunmatched
Clickstreamunmatched
Cloud Computingunmatched
Data Analysisunmatched
Data Managementunmatched
Data Processingunmatched
Data Qualityunmatched
Data Setsunmatched
Distributed Computingunmatched
GCP (Good Clinical Practices)unmatched
Javaunmatched
Large-Scale Systemsunmatched
Machine Learningunmatched
MapReduceunmatched
Memory Hardwareunmatched
Metadataunmatched
Microsoft Windows Azureunmatched
NoSQLunmatched
Oracleunmatched
Performance Tuning/Optimizationunmatched
Python Programming/Scripting Languageunmatched
Quality Managementunmatched
Query Optimizationunmatched
REST (Representational State Transfer)unmatched
Retailunmatched
SQL (Structured Query Language)unmatched
System Operationsunmatched
eCommerceunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.