Google Cloud Platform consultant with Python, Scala, Spark exp

Company: Longfinch Technologies
Location: Not Specified, Not Specified, United States
Type: Full-time
Posted: 03.SEP.2021
< >


Looking for Google Cloud Platform consultant with Python, Scala, Spark exp Location: Atlanta GA Job Type: Long Term Contract JD: * ** 7+ ...


Looking for Google Cloud Platform consultant with Python, Scala, Spark exp
Location: Atlanta GA
Job Type: Long Term Contract


    • 7+ years of experience with Information Technology and Data engineering.
    • 3+ years of experience in Big Data on Big Data, Python, Scala, Spark
    • Over 2+ years of experience as data engineer working on cloud based data lakes.
    • Experience on developing and supporting applications deployed in Google Cloud Platform (DataProc, Dataflow, Composer, Big Query, BigTable, GCS and various operators in DAG).
    • Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and data mart developments.
    • Strong knowledge and hands-on experience in SQL, Unix shell scripting
    • Knowledge and experience with full SDLC lifecycle
    • Experience with Lean / Agile development methodologies
  • Preferred Qualifications:

    • 4+ years of experience in software development life cycle
    • 4+ years of experience in Project life cycle activities on development and maintenance projects
    • Experience in Developing and supporting databases and related ETL (batch and real time processing). 3+ years of Experience in developing and supporting Hadoop systems / ETL pipelines.
    • Good understanding of Data integration, Data Quality and data architecture
    • Hands on knowledge of Google Cloud Platform on GCS, Bigtable, BigQuery
    • Proficient in a Scala, Python programming for building and automating data pipelines
    • Experience in building streaming pipelines using Kafka
    • Experience with Java, Customer Data Platform products or In house implementations and TDD Test Driven Development.
    • Good expertise in impact analysis due to changes or issues
    • Experience in preparing test scripts and test cases to validate data and maintaining data quality
    • Pre and post validation of data, strong skills in data validation frameworks, reconciliation of large data set between different systems
    • Strong understanding and hands-on programming/scripting experience skills - UNIX shell, Perl, and JavaScript
    • Hands-on development, with a willingness to troubleshoot and solve complex problems
    • Good to have knowledge on container technology such as Docker, and Kubernetes
    • Good to have knowledge on build management and CI/CD tools (Concourse, Jenkins), and monitoring tools (App Dynamics, etc.)
    • Good knowledge on Airflow orchestration and preparing DAGs
    • Ability to work in team in diverse/ multiple stakeholder environment
    • Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams
    • Experience managing team size of 2-3 would be a plus
    • Excellent verbal and written communication skills
    • Experience and desire to work in a Global delivery environment
- provided by Dice

Apply Now


Loader2 Processing ...