Data Engineer - Python, Pyspark, SQL

Company: ResolveTech Solutions Inc.
Location: Irving, Texas, United States
Type: Full-time
Posted: 13.FEB.2021

Summary

Test Required: Big Data, Need candidates with Big Data technologies-Pyton & SQL experience.7-8 years of experience. Do not send Data Science...

Description

Test Required: Big Data,
Need candidates with Big Data technologies-Pyton & SQL experience.7-8 years of experience. Do not send Data Science candidates.
Work in the digital delivery organization to partner with vendors to support delivery of data integration solutions utilizing tools such as Databricks, Python custom development, Azure containers and other Azure tool kits. Must have a strong and continuously evolving technical mastery of RESTful API development focused on Python
  • Expert knowledge of Big Data technologies including but not limited to Python and/or Databricks
  • Strong Analytical and problem solving skills
  • Knowledgeable in cloud platforms (preferable Azure), Pub/Sub (kafka), micro-services architecture, CI/CD solutions (including Docker), DevOps principles, message queue syste
  • Proficiency in API security frameworks, token management and user access control including OAuth, JWT, etc
  • Solid foundation and understanding of relational and NoSQL database princples
Reports to- Jyothsna Yenne
Responsibilities-
70%- Spark jobs for ETL development and data integrations to internal and external systems. Integration of new data sources into existing jobs.Enhancements on existing data sources and integrations .Development of custom API's for inboud/outbound data integrations
20%-Participating in designing new data applications
10%- Code deployments, Dev Ops, Reviews
- provided by Dice

 
Apply Now

Share

Flash-bkgn
Loader2 Processing ...