Title : Python Developer
Duration : Long term Contract
Location : Cupertino, CA
Job Description:
Key qualifications
* You have strong P...
Title : Python Developer
Duration : Long term Contract
Location : Cupertino, CA
Job Description:
Key qualifications
- You have strong Python coding skills
- You are able to read, generate and work with csv, tab separated, and json files
- You are interested in working with images and videos
- You can manipulate textual data and replace text in the text file in Python
- You care about proper software architecture and you are interested to learn more about modern software architecture and implement ideas using Client's large scale infrastructure tools
- You are able to define atomic components that can be chained together to perform large scale data transformation
- You are able to perform data validation and transformation and build scripts to automate these verification tasks
- You are not scared of manually exploring and examining the data using Jupyter Notebooks or other tools.
- You also have the habit of looking at the data to create intuition and lead your next steps
- You are able to handle small programming tasks without losing the big picture
- You have strong written and verbal communications skills
- Experience with Spark, Hadoop and Hive and other large scale data processing systems is a plus
- Prior knowledge of Docker, Kubernetes, Airflow, Splunk and Kafka is a plus
- Knowledge of Data Science and familiarity with Machine Learning is a big plus
Tasks and Duties
- Manipulate visual assets (images/videos) - rotation, resizing, color conversion
- Use internal REST API to retrieve data
- JSON file creation, processing and transformation
- Prepare compressed files of data (tar, zip)
- Upload and download data files to and from Client systems
- Convert image and video files to different formats
- Work with EXIF data
- Perform QA on created datasets (eg deduplication of incoming assets)
- Transform datasets from one schema to another
- Run Client models on images
- Perform various data preparation
- Produce analytics reports
Education:
- Bachelor of Science in a technical field or equivalent industry experience
- provided by Dice