Databricks Architect - Atlantic Partners Corporation
Santa Clara, CA
About the Job
Skills Required:
#LI-JS2
#LI-JG1
- 2-3 end to end project implementation experience from on-premise to cloud platform. Hands on experience working in Azure Databricks platform.
- Lead the azure cloud architecture design for various applications depending on business requirements. Deployment experience (Client, LLM, Deep learning models)
- Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks Client platform.
- Data Analysis and Preprocessing: Collect and preprocess large-scale text corpora to train and fine-tune language models. Conduct data analysis to identify patterns, trends, and insights that can inform model development and improvement.
- Strong coding skills in SQL and Python (PySpark) with experience optimizing code.
- Extensive Experience on working on Azure AI services including Data Bricks and Azure cognitive services. Proficiency in working with UNIX/Linux environments and command-line tools.
- The candidate will also be responsible for building and improving our CI/CD pipelines and keeping themselves and their team up to date with the latest industry trends and technologies.
- The candidate must be an expert in Docker and Cloud based containerization technologies.
- Hadoop/Big Data migration experience is a plus. B.E./ B. Tech / M. Tech/ MCA (Computer Science/Electronics & Communication/Electrical), a master's in computer science, artificial intelligence, or a related field, or a specialization in natural language processing is preferred.
#LI-JS2
#LI-JG1
Source : Atlantic Partners Corporation