Data Engineer III - Steneral Consulting
Lewisville, TX
About the Job
Data Engineer III
4 days Hybrid - Lewisville, Texas - Local Highly Preferred , will consider Nono Local who can relocate on Day 1
Must have Valid LinkedIn
Need DL and Visa Copy
Skills: Data Engineer, Azure Data Factory, Snowflake Cloud Data Platform, SQL, Azure cloud, Hadoop Big Data
Engineer will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. This role is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
All data on SQL server and migrating data to Snowflake
- Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements.
- Experience with object-oriented/object function scripting languages: Python etc.
- Experience building and optimizing data pipelines, architectures, and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
- Experience with Machine Learning is a great plus
- Experience with Snowflake Cloud Data Warehouse is a must
- Experience with Azure Data Factory is a must
- Experience with message queuing and stream processing such as Pub-Sub, Azure Event Grid, Kafka etc.
Source : Steneral Consulting