For a financial client we need Big Data Engineer (Python / ETL) . This position is based in Durham, NC
WE ARE Primarily looking for W2 Cand...
For a financial client we need Big Data Engineer (Python / ETL) . This position is based in Durham, NC
WE ARE Primarily looking for W2 Candidates and not looking for Third Party Candidates.
The Expertise and Skills You Bring - Bachelor's or Master's degree in a technology related field (e.g. Engineering, Computer Science, etc.) required.
- 6+ years of experience in software engineering and development
- 4+ years of experience in implementing Big data solutions in data analytics space
- Extensive experience in Object Oriented Programming (Java, Scala, Python)
- Experience with building data pipelines in getting the data required to build and evaluate ML models, using tools like Apache Spark or other distributed data processing frameworks.
- Experience Data movement technologies (ETL/ELT), Messaging/Streaming Technologies (AWS SQS, Kinesis/Kafka), Relational and NoSQL databases (Cassandra, Elastic search, Graph database), API and in-memory technologies.
- Solid understanding of developing highly scalable distributed systems using Open-source technologies
- Experience with DevOps, Continuous Integration and Continuous Delivery (Maven, Jenkins, Stash, Ansible, Docker)
- Solid experience in Agile methodologies (Kanban and SCRUM)
- Experience in developing applications in Cloud is a plus
- Strong technical design and analysis skill
- Solid understanding and technology trends in implementing of Big data ecosystem
- Solid understating of data architecture patterns such as Lambda, Kappa, Event driven Architecture, Data as a Service, Microservice etc.
- Designing, Building and supporting mission critical applications to provide the best customer experienc
- Delivering system automation by setting up continuous integration/continuous delivery pipelines
- provided by Dice