Big Data Engineer (Python / ETL)

For a financial client we need Big Data Engineer (Python / ETL) . This position is based in Durham, NC WE ARE Primarily looking for W2 Cand...

For a financial client we need Big Data Engineer (Python / ETL) . This position is based in Durham, NC

WE ARE Primarily looking for W2 Candidates and not looking for Third Party Candidates.

• Bachelor's or Master's degree in a technology related field (e.g. Engineering, Computer Science, etc.) required.
• 6+ years of experience in software engineering and development
• 4+ years of experience in implementing Big data solutions in data analytics space
• Extensive experience in Object Oriented Programming (Java, Scala, Python)
• Experience with building data pipelines in getting the data required to build and evaluate ML models, using tools like Apache Spark or other distributed data processing frameworks.
• Experience Data movement technologies (ETL/ELT), Messaging/Streaming Technologies (AWS SQS, Kinesis/Kafka), Relational and NoSQL databases (Cassandra, Elastic search, Graph database), API and in-memory technologies.
• Solid understanding of developing highly scalable distributed systems using Open-source technologies
• Experience with DevOps, Continuous Integration and Continuous Delivery (Maven, Jenkins, Stash, Ansible, Docker)
• Solid experience in Agile methodologies (Kanban and SCRUM)
• Experience in developing applications in Cloud is a plus
• Strong technical design and analysis skill
• Solid understanding and technology trends in implementing of Big data ecosystem
• Solid understating of data architecture patterns such as Lambda, Kappa, Event driven Architecture, Data as a Service, Microservice etc.
• Designing, Building and supporting mission critical applications to provide the best customer experienc
• Delivering system automation by setting up continuous integration/continuous delivery pipelines