Senior GCP Data Engineer at Cat Software Services Inc.

Job Title: GCP Data Engineer

Location: Irving, TX (Onsite)

Project Duration: 12 months Contract

Relocation available from Day 1

The ideal candidate will have strong Streaming experience and Dataflow with Java experience

Keyword Phrases:

What the Client is looking for:

Hadoop + GCP Sr. Engineer 
Kafka Streaming - Partitions, topics, consumer groups does he work or not
Hive Queries to point external tables
Oozie scheduling and GCP Airflow scheduling
Hadoop configurations like admin activities
Spark streaming jobs,
GCP pub-sub and subscriptions
GCP data flow custom template creation

Job Description:

Should have GCP Cloud Experience.

Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing, and curation

ETL development experience with a strong SQL background, analyzing huge data sets, trends, and issues, and creating structured outputs.

Experience in building high-performing data processing frameworks leveraging Google Cloud Platform.

Experience in building data pipelines supporting both batch and real-time streams to enable data collection, storage, processing, transformation, and aggregation.

Experience in utilizing GCP Services like Big Query, Airflow, Cloud Composer, Dataflow, Pub-Sub, Cloud Monitoring, and Data Proc.

Understand ETL application design, data sources, data targets, relationships, and business rules.