Data Engineering Architect – Data Platform in New York, NY at ConsultNet

Date Posted: 12/4/2019

Job Snapshot

Job Description

Title: Data Engineering Architect - Data Platform
Location: New York, NY (downtown)
Duration: 12 months with a probable extension

JOB DESCRIPTION:

The Role:
You live to break down and solve complex problems by creating practical, maintainable, and scalable solutions. You're a great person that willingly collaborates, listens and cares about your peers. Then you have the best premises to join our team.

Your responsibilities will include but are not limited to:
  • Scalability and hardening of the data platform. Design and implementation of Multi-tenancy, High-availability, Failover, and Disaster Recovery architectures that delivers high-performance data storage, processing, analytics and delivery capabilities.
  • Collaborate closely with the Director of Data Engineering as well as our development team in India.
  • Work with and drive the integration of best-in-class technologies in BI, Big Data & Cloud
  • Proven technical leadership experience in development, testing and implementation of large scale, complex technology projects.
Knowledge & Skills:
  • Masters degree in Computer Science, related technical field or equivalent practical experience.
  • 5-10 years experience in Solutions Architecture and all of its phases (Data, Application, Infrastructure)
  • 3-5 years experience working in Big Data and Cloud Technology transformation projects running in production environments.
  • At least 3 years experience in a global scale organization ideally in commodity and/or financial markets working on relevant Big Data and IT projects as cloud engineer.
  • Experience in Apache Kafka a must.
  • Experience in Apache Spark a must.
  • Experience in container technology (docker) and Kubernetes a must.
  • Experience in Data Lake implementations using technologies such as AWS Lake Formation.
  • Working experience Real-time processing (stream technology).
  • Working experience in Serverless technology (AWS Lambda)
  • Working experience in Graph Technologies.
  • Good understanding of Machine Learning, Deep Learning and AI concepts using latest technologies (e.g. AWS SageMaker. Comprehend and/or DeepLense).
  • Ability to effectively communicate & collaborate across multiple non-technical functions within the organization (e.g. Product Management, Sales, Marketing, Editorial, ...).
  • Strong sense of ownership, urgency, and drive. Ability to focus on relevant business metrics and topline growth.
  • Strong English written and verbal communication skills
Preferred candidates do also provide:
  • Deep commodity market and/or financial market understanding and significant working experience.



Be a part of the ConsultNet difference. As a leading national provider of IT staffing and solutions, ConsultNet delivers exceptional services to startup, midmarket and Fortune 1000 companies across North America. Since 1996, we've partnered with clients to create rewarding opportunities for our consultants, successfully building teams that have surefire results.
In the past two years alone, we have placed more than 1,500 consultants in contract, contract-to-hire, or direct placement opportunities. We understand communication is key to finding the right job that matches your skills and career goals. For us, it's not just the work that we do; it's how we do the work. Our breadth of offerings extends to multiple IT positions in major markets throughout the country, see more at www.consultnet.com