Big Data Engineer in McLean, VA at Consultnet Careers

Date Posted: 6/27/2024

Job Snapshot

  • Employee Type:
    Full-Time
  • Location:
    McLean, VA
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
    6/27/2024
  • Job ID:
    24-01306

Job Description

Senior Data Engineer


Remote- must work standard EST hours


Long term contract/ contract to hire



Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data Engineer role supports data delivery, serving, design, monitoring, and security management for data science, graph, and machine learning engineering teams.




Requirements


7+ years of relevant experience


Demonstrable AWS knowledge - EC2, ECS, Lambda, S3, EMR


Strong programming ability in Python or Scala


Experience with SQL and relational data


3+ years experience in one or more big data technology : S3, HDFS, Spark, Presto, etc. SPARK preferred


Experience designing and implementing ETL pipelines to support Data Science and/or Machine Learning.



Nice to have


Feature Store build experience and Dagster


Financial industry experience