Python Developer

Company: Luxoft
Location: Middletown, New Jersey, United States
Type: Full-time
Posted: 12.FEB.2021
< >

Summary

Project Description Role is a big data software engineer, supporting several different applications and projects in the Data Science departm...

Description

Project Description Role is a big data software engineer, supporting several different applications and projects in the Data Science department. One of the applications builds video session records from one of the Data Science feeds - Creates a daily report based off the video session records by service providers. Another application receives and scans data and publishes it to one of the datalakes. Maintaining statistics on ingested and published files.Responsibilities This person will need to be able to:• be plugged into any project in a developer capacity• be able to translate business requirements into software architecture and design• and execute - develop code, build and execute unit testing, work with product owners, other developers and leads on the team, QA and support personnel to architect, design, build, test, deploy, fix and support her code. Skills Must have • Python programming experience• Pyspark - allow python to access a Hadoop environment through SPARK• SQL (querying and working with major SQL DBs - e.g. Oracle, Postgres, MySQL, ..)• Extensive experience working in a Linux and Hadoop environment• Shell scripting• HDFS dfs CLI - command line interface• Experience with processing large amounts of dataodata ingestion, data movement, data cleansing, data quality• Kafka• Excellent communication skills, team player• Knowledge of Hive, Postgres• computer science, algorithms and optimization Nice to have • Azure• C• DataBricks• Snowflake• Palantir Languages English: C2 ProficientRelocation package If needed, we can help you with relocation process. Click here for more details: see more details Work Type Other System LanguagesRef Number VR-57281

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...