Data Engineer with Python and AWS

Company: Cygnus Professionals
Location: Not Specified, Not Specified, United States
Type: Full-time
Posted: 08.APR.2021

Summary

Title: Data Engineer with Python and AWS Location: Remote Duration: Long Term Job Description: • 8+ years of experience in data pipeline...

Description

Title: Data Engineer with Python and AWS

Location: Remote

Duration: Long Term

Job Description:

• 8+ years of experience in data pipeline engineering for both batch and streaming applications

• Must be hands-on coding capable in at least a core Language skill of (Python, Java or Scala) with Spark

• Expertise in working with Distributed DW and Cloud Services (like Snowflake, Redshift, AWS, etc.) via scripted pipelines for at least 2 years

• Leveraged frameworks & orchestration like Airflow as required for ETL pipeline

• This role intersects with 'Big Data' stack to enable varied Analytics, ML, etc. Not just 'DW' type workload

• Solid grasp of database engineering and design

• Identify bottlenecks and bugs in the system and develop scalable solutions

• Unit Test & Document deliverables

• Capacity to successfully manage a pipeline of duties with minimal supervision

Required Technical Skills:

• Python, SQL, DW Concepts & Logic

• Airflow orchestration

• Cloud DWH - Snowflake

• AWS Cloud knowledge

• Nice to have: Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores

- provided by Dice

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...