Data Engineer - Palantir Foundry, Python, Spark

Company: Pull Skill Technologies
Location: El Segundo, California, United States
Type: Full-time
Posted: 07.APR.2021

Summary

Role: Data Engineer - Palantir Foundry, Python, Spark Location: El Segundo, CA Duration: 1 year duration About the Team Our Strategic Op...

Description

Role: Data Engineer - Palantir Foundry, Python, Spark

Location: El Segundo, CA

Duration: 1 year duration

About the Team

Our Strategic Operations Dashboards/Reporting team is looking for a Digital Engineer to help define, build and maintain a data lake and data pipeline. Our team has responsible for reporting on the site reliability of the AT&T Digital Experience. This covers all aspects of the customer journey as they interact with our online presence. The data engineer would work across teams to define data sets to meet requirements, secure the data and make it available to analysts to construct dashboards and perform ad-hoc analysis.

About the Job

This is a fast paced, critical position. The company is in the midst of transforming from legacy technologies to modern technologies while implementing an SRE support model. A good candidate would have experience working with business and product owners in drafting requirements for metrics and KPIs. They would also require experience working with development and other technical teams to
understand the data and setup pipelines to a common repository from which reports and dashboards can be created.

Responsibilities and Day-to-Day View

? Ensure complete and accurate data loads into AT&T Data lakes
? Work with business, product, and process owners to define reports, KPIs and Metrics
? Work with Strategic Platform Operations teams to define reports, alerts, KPIs and Metrics
? Work with Development and Infrastructure teams to secure data feeds to support requirements
? Create processes for data set verification, acquisition, mining, and modeling
? Design and monitor real-time and batch data processing
? Develop algorithms to find trends in data and make it more useful to the enterprise
? Serve as Subject Matter Expert to team members regarding data engineering and data tools

Required Qualifications

? Bachelor's degree in Computer Science or related field
? 5+ years experience in Information Technology
? 3+ years experience in data engineering
? Experience using REST APIs to extract data

Preferred Qualifications

? Experience with Palantir Foundry
? Experience with languages such as SQL, python, SQLSpark, PySpark
? Experience training others preferred
? Experience with visualization tools such as PowerBI and Tableau
? Experience with Oracle and Informatica
? Experience with tools such as ELK, Splunk, Dynatrace, Catchpoint, Quantum Metric
? Experience working in a Scaled Agile Team
? Master's in computer science with a focus on data

- provided by Dice

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...