ETL Developer ( Python and Spark) - Contract to Hire

Company: R Systems, Inc.
Location: Not Specified, Not Specified, United States
Type: Full-time
Posted: 10.AUG.2021

Summary

100% Remote Contract to Hire position Primary Responsibilities * Help manage the data ingestion lifecycle Identify data sources and locat...

Description

100% Remote

Contract to Hire position

Primary Responsibilities

  • Help manage the data ingestion lifecycle Identify data sources and locations
  • Work with managers to catalog and prioritize data sets
  • Work with clients to extract data into our AWS S3 Data Lake (usually via SFTP or API pull)
  • Use AWS Glue and similar tools to transform data into our Data Warehouse
  • Optimize our data across sources for use by our BI Tools and Node.js API
  • Be a thought leader on improving our data pipelines and technologies
  • Troubleshoot data integrity issues
  • Understand our security and compliance requirements related to our data processes

Required Experience

  • At least 2 - 3 years of SQL experience.
  • Exposure to PostgreSQL is required.
  • You will be tested on your SQL knowledge.
  • At least 2 - 3 years of experience delivering ETL, data warehouse and data analytics capabilities.
  • Strong professional experience with Python and/or Spark.
  • You will be tested using PySpark if you say you have this experience.
  • At least 2 - 3 years experience working with an industry leading ETL tool. AWS Glue considered a big bonus.
  • Experience integrating customer data into an existing data model (such as SalesForce).
  • Experience dealing with GDPR and PII data is required.
- provided by Dice

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...