Data engineer with Databricks , Python and Pyspark

Company: Cyma Systems Inc
Location: New York, New York, United States
Type: Full-time
Posted: 07.APR.2021

Summary

Data engineer with Databricks , Python and Pyspark. Location : New York City, NY Job Description: Databricks PySpark AWS Python SQL Comp...

Description

Data engineer with Databricks , Python and Pyspark.

Location : New York City, NY

Job Description:

Databricks
PySpark
AWS
Python
SQL

Compass is a real estate company headquartered in NYC with a critical business goal of expansion into multiple markets by the end of 2020. To support this expansion, We will provide a team of engineers and associates for its Data Intelligence team.

· Design, develop and Unit Test real-time and batch data ingestion pipelines using pySpark
· Design, develop and Unit Test real-time and batch data processing/transformation pipelines using pySpark
· Design, develop and Unit Test real-time and batch target data load pipelines using pySpark
· Create , schedule and run Databricks jobs

- provided by Dice

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...