Jr Python Data Engineer

Company: Insight Global
Location: New York, New York, United States
Type: Full-time
Posted: 31.AUG.2021
< >

Summary

Insight Global is looking for a Jr Python Engineer that is interested in pursuing a career in Big Data to join the Data Architecture and Gov...

Description

Insight Global is looking for a Jr Python Engineer that is interested in pursuing a career in Big Data to join the Data Architecture and Governance team at one of our largest healthcare clients in NYC. They will be responsible for backend data engineering to help streamline the multiple data sources into the data lake by building out data pipelines that will process the data on an hourly, weekly, monthly basis. This data consists of clinical, research, data files from other institutions, and salesforce data, etc. The team is slowly moving Hadoop into the AWS cloud and this engineer will be responsible for any initiatives in regards to big data such as master data management, data architecture, and data governance. They will support and build the data pipelines and assist the rest of the team that specialize in python, R, and SAS programming with how these languages connect to the data lake. The data pipelines are based in open source technologies so having Java development experience is a must. They will be assisting in creating APIs and moving the data environment to the cloud. The manager is willing to teach this individual Hadoop as long as they have a passion to learn and can understand how Hadoop connects the other languages to the data lake. We are looking for someone who can not only take on a leadership type of role with the off shore consultants but also learn from them as well. Minimum Requirements3+ years experience with Python programming with interest in Hadoop and big dataExperience writing complex SQL queries to manipulate and extract thousands of rows of dataExperience creating and developing APIs Unix/Linux Scripting experience to write commands (can be any scripting language)Experience working within a cloud environment, specifically AWS Desired SkillsHadoop experience Experience with R or SAS or Tableau

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...