Spark Developer (Scala/Python) in New York, NY at ConsultNet

Date Posted: 7/31/2020

Job Snapshot

Job Description

Title: Spark Developer
Location: NYC
Duration: 6 months

An ideal candidate will be a key player in the growth and development of this brand new platform. They will a play a role in the planning, development and deployment of the product following the full SDLC. They should be comfortable handling new challenges involving emerging technologies. The candidate must follow best practices for software development and has experience building reusable and maintainable application code for future projects.
Development experience with Amazon Web Services (AWS) is expected
Required Skills & Experience
  • Demonstrated ability to participate in a global software engineering team while working closely with product management, quality assurance and business analysts.
  • At least 3-4 years hands on experience developing with Apache Spark streaming and batch framework with Scala and PySpark (optional)
  • Spark query tuning and performance optimization
  • Service oriented architecture, and data standards like JSON, Avro, Parquet, Protobuf
  • Experience working with SQL technologies such as PostgreSQL, Oracle or equivalent
  • Experience working withHDFS, S3, and/or DynamoDB
  • Development experience with AWS
  • Having AWS Glue experience is a plus
  • Experience working with Docker & Kafka
  • Exposure for programming languages like Java, .Net is a plus
  • Awareness about CI/CD, Jenkins is a plus
  • Proven experience working with an Agile framework mindset
  • Desire to work with a highly collaborative team located onshore and offshore
  • Strong interpersonal and written communications skills

Basic Qualifications:
  • Bachelor's degree in computer science or related fields.
  • Previous experience in software development, computer engineering, or other related fields.
  • Ability to work well in team environment following Agile software development principles.
  • Strong interpersonal and written communications skills.
  • Demonstrated ability to successfully multi-task.
  • High energy and a self-starter.

Be a part of the ConsultNet difference. As a leading national provider of IT staffing and solutions, ConsultNet delivers exceptional services to startup, midmarket and Fortune 1000 companies across North America. Since 1996, we've partnered with clients to create rewarding opportunities for our consultants, successfully building teams that have surefire results.
In the past two years alone, we have placed more than 1,500 consultants in contract, contract-to-hire, or direct placement opportunities. We understand communication is key to finding the right job that matches your skills and career goals. For us, it's not just the work that we do; it's how we do the work. Our breadth of offerings extends to multiple IT positions in major markets throughout the country, see more at


  1. Software Engineer Jobs
  2. Project Engineer Jobs