Big Data Engineer - AWS in Herndon, VA at ConsultNet

Date Posted: 11/23/2020

Job Snapshot

  • Employee Type:
    Full-Time
  • Location:
    Herndon, VA
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
    11/23/2020
  • Job ID:
    20-01498

Job Description

THE COMPANY
Our Fortune 100 client provides reliable, large-scale access to affordable mortgage credit in communities across our nation. We are the leading source of funding for housing in America, which means more people can buy or rent a home. We are focused on sustaining the housing recovery, improving our company, and leading change to make housing better.
Join our diverse, high-performing team and make a difference as we work together to enable access to a good home.

JOB INFORMATION
Use modern tools, techniques, and methods to develop, modify, or update applications used by business units or infrastructure units. Lead, or play lead technical role in development teams' efforts to determine unit needs and business processes that are automated by the application. Participate in or review all of the steps in the software development life cycle to create and modify the software.

KEY JOB FUNCTIONS
Work with product owners and other development team members to determine new features and user stories needed in new/revised applications or large/complex development projects.
Create or Update documentation in support of development efforts. Documents may include detailed specifications, implementation guides, architecture diagrams or design documents.
Participate in code reviews with peers and managers to ensure that each increment adheres to original vision as described in the user story and all standard resource libraries and architecture patterns as appropriate.
Respond to trouble/support calls for applications in production in order to make quick repair to keep application in production.
Serve as a technical lead for an Agile team and actively participate in all Agile ceremonies. Participate in all team ceremonies including planning, grooming, product demonstration and team retrospectives.
Mentor less experienced technical staff; may use high end development tools to assist or facilitate development process.
Leverage our client's DevOps tool stack to build, inspect, deploy, test and promote new or updated features.
Set up and configure a continuous integration environment.
Advanced proficiency in unit testing as well as coding in 1-2 languages (e.g. Java, etc).
Advanced proficiency in Object Oriented Design (OOD) and analysis. Advanced proficiency in application of analysis/design engineering functions. Advanced proficiency in application of non-functional software qualities such as resiliency, maintainability, etc. Advanced proficiency in advanced behavior-driven testing techniques.

Qualifications:
EDUCATION
Education Level Required
Bachelor Degree or Equivalent
Area of Study Preferred
Business or Computer Science
Certifications Preferred
Specialized training in specific platforms, enterprise

MINIMUM EXPERIENCE
4-6 years of related experience; Experienced with Agile practices/ methodologies (e.g. Scrum, TDD, BDD, etc).

Required Skills:
2+ years with Big Data Hadoop cluster (HDFS, Yarn, Hive, MapReduce frameworks), Spark
2+ years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, EMR, AWS Batch, Dynamo DB, Redshift, Cloudwatch, RDS, Lambda, SNS, SQS etc.)
4+ years of Java/Python, SQL, SparkSQL, PySpark
Excellent problem-solving skills, strong verbal & written communication skills
Ability to work independently as well as part of a team

Desired Skills:
Knowledge of Spark streaming technologies, Graph Database will be a nice to have
Familiar with Hadoop information architecture, data modeling, machine learning, Talend
Knowledge of Financial Products, Risk Management, Portfolio Management is preferred but not mandatory. Training will be provided to help you gain ground


-----------------------------------------------------------------------------------------------------

Be a part of the ConsultNet difference. As a leading national provider of IT staffing and solutions, ConsultNet delivers exceptional services to startup, midmarket and Fortune 1000 companies across North America. Since 1996, we've partnered with clients to create rewarding opportunities for our consultants, successfully building teams that have surefire results.
In the past two years alone, we have placed more than 1,500 consultants in contract, contract-to-hire, or direct placement opportunities. We understand communication is key to finding the right job that matches your skills and career goals. For us, it's not just the work that we do; it's how we do the work. Our breadth of offerings extends to multiple IT positions in major markets throughout the country, see more at www.consultnet.com