AWS – Databricks Architect - Diverse Linx
San Diego, CA
About the Job
Role: AWS Databricks Architect
Location: Location: San Diego, CA onsite only
YOE: (12 +Yrs of Experience)
Fulltime
JD:
Lead and manage a team of engineers and Sr engineers by providing guidance, mentorship, and fostering a collaborative work environment.
Establish and maintain positive relationships with client stack holders
Consult with client on project status, proposals, and technical issues and provide post-implementation support to them
Facilitates communication and collaboration between onshore and offshore teams, and ensure the successful design, development and execution of the product\project\deliverables on time
Experience in POC development, Capacity sizing, Tool Evaluation
MUST Have
Possess excellent written and verbal communication skills.
Ability to run ETL jobs in Databricks
Unity catalog with delta, MongoDB, regular s3 based parquet files
Delta format based S3
Ability to articulate pros and cons of delta format
Ability to run Databricks with AWS glue catalog
Monitoring of Databricks jobs
Operations related experience of Databricks jobs
Best practices of setting up nested ETL jobs
Scheduling of jobs in Databricks
Passing runtime parameters to ETL jobs
Handling experience in AWS in data engineering project
Ability to coordinate/work with team in India
Good to Have
o Experience in client facing role
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Location: San Diego, CA onsite only
YOE: (12 +Yrs of Experience)
Fulltime
JD:
Lead and manage a team of engineers and Sr engineers by providing guidance, mentorship, and fostering a collaborative work environment.
Establish and maintain positive relationships with client stack holders
Consult with client on project status, proposals, and technical issues and provide post-implementation support to them
Facilitates communication and collaboration between onshore and offshore teams, and ensure the successful design, development and execution of the product\project\deliverables on time
Experience in POC development, Capacity sizing, Tool Evaluation
MUST Have
Possess excellent written and verbal communication skills.
Ability to run ETL jobs in Databricks
Unity catalog with delta, MongoDB, regular s3 based parquet files
Delta format based S3
Ability to articulate pros and cons of delta format
Ability to run Databricks with AWS glue catalog
Monitoring of Databricks jobs
Operations related experience of Databricks jobs
Best practices of setting up nested ETL jobs
Scheduling of jobs in Databricks
Passing runtime parameters to ETL jobs
Handling experience in AWS in data engineering project
Ability to coordinate/work with team in India
Good to Have
o Experience in client facing role
Thanks & Regards,
Shashi Bhushan
Diverse Lynx LLC |300 Alexander Park|Suite #200|Princeton , NJ 08540
Office: +732-452-1006 ext:344
Email: shashi.bhushan@diverselynx.com | URL: http://www.diverselynx.com
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx