Sr. Data Engineer - ConsultNet

Title: Data Engineer
Location: New York, NY (on-site)
Type: 1-year long contract with extensions

Overview:
We're looking for multiple Data Engineers to play a critical role in designing, developing, and maintaining robust data pipelines that transform raw data into valuable insights for a Fortune 500 company within FinTech.

Responsibilities:

• Design, develop, and maintain data pipelines using GCP services like Dataflow, Dataproc, and Pub/Sub, in addition to developing and implementing data ingestion and transformation processes using tools like Apache Beam and Apache Spark.
• Manage and optimize data storage solutions on GCP, including Big Query, Cloud Storage, and Cloud SQL, while implementing data security and access controls using GCP's Identity and Access Management (IAM) and Cloud Security Command Center.
• Monitor and troubleshoot data pipelines and storage solutions using GCP's Stackdriver and Cloud Monitoring tools.
• Collaborate with data experts, analysts, and product teams to understand data needs and deliver effective solutions.
• Automate data processing tasks using scripting languages like Python.

• 10+ years of experience overall
• 4+ years of recent experience working for a Major Bank or Brokerage house in the US
• 8+ years' experience designing, developing, and deploying data pipelines
• 5+ years of experience with Python & SQL for data manipulation and querying
• 5+ years working on Google Cloud Platform (GCP) including experience with the following services:
  • Dataflow, Dataproc, and Pub/Sub
• 5+ years of experience with core data services GCS, BigQuery, Cloud Storage, and Dataflow.
• Experience managing and optimizing data storage Big Query, Cloud Storage, and Cloud SQL.
• Experience with the distributed data processing framework Apache Beam and Apache Spark.

Welcome to ConsultNet and the family of companies, Tekne, SaltClick, TechBridge, and OmniMedia. As a premier national provider of technology talent and solutions, our expertise spans across project services, contract-to-hire, direct placement, and managed services both onshore and nearshore.

Celebrating more than 25 years of partnership with a diverse client base, we've crafted rewarding opportunities for our consultants, fostering high-performing teams that deliver impactful results.

Over the last few years thousands of consultants have found their calling with us in roles that have made a meaningful impact on their lives, enhanced their career, challenged them, and propelled them towards achieving their personal and professional goals. At the ConsultNet family of companies, we believe effective communication is crucial in aligning the right job with your unique skills and professional aspirations. To us, it's all about the personal approach we take and the values we uphold.

Our comprehensive service offerings cover a wide range of technology positions across key markets nationwide. Client more at www.consultnet.com .

We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.