Jr Python Data Engineer

Company: Insight Global
Location: New York, New York, United States
Type: Full-time
Posted: 03.SEP.2021
< >

Summary

Must haves: - 3+ years' experience with Python programming with interest in Hadoop and big data - Experience writing complex SQL queries to ...

Description

Must haves:
- 3+ years' experience with Python programming with interest in Hadoop and big data
- Experience writing complex SQL queries to manipulate and extract thousands of rows of data
- Experience creating and developing APIs
- Unix/Linux Scripting experience to write commands (can be any scripting language)
- Experience working within a cloud environment, specifically AWS

Plusses:

  • Hadoop experience
  • Experience with R or SAS or Tableau
Day to Day:
Insight Global is looking for a Jr Python Engineer that is interested in pursuing a career in Big Data to join the Data Architecture and Governance team at one of our largest healthcare clients in NYC. They will be responsible for backend data engineering to help streamline the multiple data sources into the data lake by building out data pipelines that will process the data on an hourly, weekly, monthly basis. This data consists of clinical, research, data files from other institutions, and salesforce data, etc. The team is slowly moving Hadoop into the AWS cloud and this engineer will be responsible for any initiatives in regards to big data such as master data management, data architecture, and data governance. They will support and build the data pipelines and assist the rest of the team that specialize in python, R, and SAS programming with how these languages connect to the data lake. The data pipelines are based in open source technologies so having Java development experience is a must. They will be assisting in creating APIs and moving the data environment to the cloud. The manager is willing to teach this individual Hadoop as long as they have a passion to learn and can understand how Hadoop connects the other languages to the data lake. We are looking for someone who can not only take on a leadership type of role with the off shore consultants but also learn from them as well.

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...