Sr. Big Data Engineer with Good Python Experience

Hi, Greetings from SecureKloud……..! Title: Sr. Data Engineer. Location: Pleasanton, CA. Duration: Long Term. Data Engineer Data Engine...

Hi,

Greetings from SecureKloud……..!

Title: Sr. Data Engineer.

Location: Pleasanton, CA.

Duration: Long Term.

Data Engineer

Data Engineer to work on an agile team developing and maintaining an analytics platform using Python. Work closely with other data and software engineers to build and maintain data pipelines using pure Python and/or Glue/Airflow. Must have considerable experience writing production-ready code in Python. Self-starter able to make progress without much direction.

Key Responsibilities

• Develop and maintain scalable data pipelines
• Develop and maintain RESTful JSON apis (FastAPI)
• Consume RESTful apis
• Understand and maintain data schemas and architectures
• Understand and architect ETL processes
• Deploy data science models as microservices
• Synthesize requirements from non-technical stakeholders
• Work closely with data governance and technology practice areas
• Work on agile teams (Scrum/Kanban)

Qualifications, Skills & Knowledge

• Python (FastAPI, Pandas preferred)
• Git/Github (branches, code reviews, pull requests)
• RDBMS/NoSQL (MySQL preferred)
• Docker
• PySpark
• Scala
• Airflow
• Plotly/Dash experience preferred
• AWS experience preferred (lambda/glue/s3).

Regards,

Muthu.k,

Senior Associate.

SecureKloud Technologies

HQ : 4309 Hacienda Drive, Suite 150, Pleasonton, CA 94588, USA.

Mobile: | |