Santa

Millennium Global Technologies

Location

Santa Clara, CA | United States

Job description

Position Databricks Architect ( 10+ years )

Location Santa Clara, CA ( Day 1 onsite)

Skills Required:

2-3 end to end project implementation experience from on-premise to cloud platform. Hands on experience working in Azure Databricks platform.
Lead the azure cloud architecture design for various applications depending on business requirements. Deployment experience (ML, LLM, Deep learning models)
Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks ML platform.
Data Analysis and Preprocessing: Collect and preprocess large-scale text corpora to train and fine-tune language models. Conduct data analysis to identify patterns, trends, and insights that can inform model development and improvement.
Strong coding skills in SQL and Python (PySpark) with experience optimizing code.
Extensive Experience on working on Azure AI services including Data Bricks and Azure cognitive services. Proficiency in working with UNIX/Linux environments and command-line tools.
The candidate will also be responsible for building and improving our CI/CD pipelines and keeping themselves and their team up to date with the latest industry trends and technologies.
The candidate must be an expert in Docker and Cloud based containerization technologies.
Hadoop/Big Data migration experience is a plus. B.E./ B. Tech / M. Tech/ MCA (Computer Science/Electronics & Communication/Electrical), a master's in computer science, artificial intelligence, or a related field, or a specialization in natural language processing is preferred.

Report this job

Job tags

Salary