Big Data Engineer

ABOUT US:

Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world's top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people's lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint.

We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.

Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.

KEY RESPONSIBILITIES

• Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow - including their monitoring, alerting, and recovery.
• Write SQL and Python for data ingestion, transformation, and the datasets that analysts and dashboards depend on.
• Own data quality for what you build - run the checks before you ship and add new ones where they're missing; confirm the results are correct, not only that the job completed.
• Build and extend the data models for your area: fact and dimension tables following the team's layering conventions.
• Keep your jobs efficient - watch runtime and cost, and raise slow or expensive jobs rather than living with them.
• Use and extend the team's shared patterns and templates, and turn work you find yourself repeating into something automated or reusable.
• Work with analysts and business stakeholders to turn requests into datasets that actually get used.