Tech Manager-Big Data Engineer in San Francisco, CA at ConsultNet

Date Posted: 4/9/2021

Job Snapshot

Job Description

Tech Manager Big Date Engineer

Direct Hire

Target Salary- $125,000-$180,000

Lead, manage, and mentor a strongteamof Data Engineers focusedto deliver large-scale projects, through resource planning and allocation. Inculcate strong Agile delivery philosophy.

Partner with the Product Management team to define and execute an effective backlog.
Architect and design large scale data analytics infrastructure in cloud (performance, reliability, monitoring, self-service)to deliver best-in-class data pipelines supporting key data initiatives for Enterprise Data, BI and Reporting team.
Evolve platform maturity in automation, operations, stability, and support.
Thinking through long-term impacts of key design decisions and handling failure scenarios.
Maintain awareness of industry trends and evaluate applicability of new software tools toplatformdevelopment.
Lead projects and prioritization of systems integrations, data migrations, and data processing required by cross-functional product and application teams
Work in close collaboration with your data-minded colleagues focused on Back End Service Development, reporting, analytics, and machine learning.



Bachelor's degree in Computer Science and/or Engineering. Master's Degree preferred.
8+ years of experience in data engineering working closely with Analytics/Data Science teams.
4+ years hiring, managing and mentoring teams of data engineers
Strong leadership profile and excellent prioritization and negotiation skills, capable of managing multiple streams of work in parallel with aggressive timelines.
Strong background in data warehousing and data engineeringwith data architecture, data modeling, schema design and/or software development.
Experience in designing and developing ETL data pipelines including building open source data pipeline systems (e.g. Kafka, Apache AirFlow, Apache Beam and Apache Spark).
Proficiency in SQL and at least one of the programming languages (Python, Java, Scala etc.)
Demonstrated success in leading a Data Engineering or ETL Team at enterprise level.
Experience with Relational and unstructured databases, enterprise data warehouse and cloud data solutions or analytics systems such as MySQL, PostgreSQL, Redshift, and Elasticsearch.
Experience with any one cloud service provider such as AWS/GCP/Azure (preferably GCP).
Working experience in a GCP Cloud environment with a subset of the following tools or their equivalent - BigQuery, Dataflow, Pub/Sub, Cloud Composers, GCS, and BigTable.
Eager to learn new things and passionate about technology.
Excellent communication skills, empathy, initiative and ownership.

Be a part of the ConsultNet difference. As a leading national provider of IT staffing and solutions, ConsultNet delivers exceptional services to startup, midmarket and Fortune 1000 companies across North America. Since 1996, we've partnered with clients to create rewarding opportunities for our consultants, successfully building teams that have surefire results.

In the past two years alone, we have placed more than 1,500 consultants in contract, contract-to-hire, or direct placement opportunities. We understand communication is key to finding the right job that matches your skills and career goals. For us, it's not just the work that we do; it's how we do the work. Our breadth of offerings extends to multiple IT positions in major markets throughout the country, see more at


  1. Software Engineer Jobs
  2. Project Engineer Jobs