Data Engineer - Spark and Python

Company: Advent Global Solutions, Inc.
Location: Not Specified, Not Specified, United States
Type: Full-time
Posted: 10.AUG.2021

Summary

Hello, We have an Immediate Contract Data Engineer Opportunity. Please feel free to call me at and please drop an updated resume to Role: ...

Description

Hello,

We have an Immediate Contract Data Engineer Opportunity. Please feel free to call me at and please drop an updated resume to

Role: Data Engineer Location: Cupertino, CA (remote is ok) Duration: Long Term Contract

Must have
Expertise in Spark, Hive/Spark SQL, and Python- is a MUST

Nice to have
Experience building data pipelines with Airflow or similar tool
Experience with database design

Job Description

We are looking for a data engineer to support our efforts to rapidly develop data pipelines to transform large datasets into aggregated tables of metrics according to business logic. These metrics will then be stored in a database, structured to support rapid querying by a front-end web app that uses this data to display dashboards for internal stakeholders.

They'll be working on:

  • Orchestrating data pipelines
  • Optimizing PySpark/Spark SQL jobs
  • Architecting database infrastructure

Requirements:

  • Expertise in Spark, Hive/Spark SQL, and Python
  • Experience building data pipelines with Airflow or similar tool
  • Experience with database design

Thanks & Regards,

Mike P.

Senior Talent Acquisition Specialist

Direct:

Email ID:

- provided by Dice

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...