Big Data Engineer - Ampcus Incorporated

Buffalo, NY

About the Job

Bravens Inc., a wholly owned subsidiary of Ampcus Inc., is an information technology consulting and services company. Bravens is a leader in providing tailored staffing solutions across both IT and non-IT industries. We are in search of a highly motivated candidate to join our talented team and contribute to our ongoing success.

Role : Big Data Engineer
Location : Buffalo NY

Responsibilities:

Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.
Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake
Languages: Python, SQL and Shell Scripting.
Databases: MySQL, Teradata, and SQL SERVER.
Orchestration/Tools: Oozie, Airflow, CTRL-M, Maven, Jenkins, IntelliJ, GIT
Expertise in all components of Big Data Ecosystem- Spark, Hive, Sqoop, Oozie, Impala and Hue
Extensive Experience with AWS services ensuring efficient data management and analysis.
Successfully led the migration of legacy systems to Datawarehouse environments and Cloud, utilizing Informatica, Snowflake and AWS technologies, resulting in improved scalability, performance, and cost-effectiveness.
Extensively worked with lambda, S3, cloud watch, SQS, SNS ,Step Functions and IAM roles in AWS services.
Extensive knowledge on data serialization techniques like Avro, Sequence Files, Parquet, JSON and ORC.
Experienced in handling databases: MySQL, SQL Server, Teradata.
Expertise working across all phases of SDLC requirements gathering, system design, development, enhancement, maintenance, testing, deployment, production support, and documentation.
Working experience in creating complex data ingestion pipelines, data transformations, data management and data governance in a centralized enterprise data hub.
Knowledge of Kubernetes ecosystem.
Did Data analysis and interpretation Using Databricks features to perform data transformations, run queries, and build visualizations collaborating Working with diverse teams to deliver insights in Analytics platform. – good to have.
Strong problem-solving skills
Strong team player with good communication, analytical, presentation and inter-personal skills.

Bravens is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identify, national origin, age, protected veterans or individuals with disabilities.

Source : Ampcus Incorporated