Data Engineer at TRINITY INFOTECH INC

Top Skills' Details

Lead/Senior Big Data Developer - This person will not be leading the team or have any direct reports but will be a senior developer on the team who can provide technical mentorship to other engineers. Preference is to start with candidates local to DC/MD/VA and NYC. This is a 100% remote role and candidates will not be required onsite regularly.
- Prior to an interview with the client, candidates must complete a Glider assessment, which I will send to candidates directly.

1. Exp programming in Scala.
2. Strong experience in big data technologies like AWS EMR and Apache Spark
3. Strong experience with serverless technologies like AWS DynamoDB and AWS Lambda
- Chosen database is AWS Aurora
4. Technical experience in all the areas listed below:
- Experience working with JSON files as data will be coming in as JSON files
- Ability to write complex SQL queries
- Strong experience in performance tuning and optimization
- Strong unit testing using JUnit or ScalaTest is minimum expectation, data testing experience would be great
- Git/Maven/Gradle

Tech Stack:
Scala is main programming language for the team.
Aurora is database.
SQL is backend database
ETL process is Scala/Spark on EMR clusters.
Code reviews are large aspect of team culture.
Agile environment with 2-week sprints