Birlasoft
Location
Bangalore | India
Job description
We are looking for an experienced Systems Architect to spearhead the development of a state-of-the-art question answering system. This role is unique as it involves creating a system that leverages advanced NLP algorithms without the use of generalized AI or large language models. The successful candidate will be responsible for building a robust backend architecture, focusing on efficiency, scalability, and accuracy.
Key Responsibilities : System Design and Architecture: Architect a high-performance, scalable system for NLP-based question answering. Design systems for effective handling and processing of natural language data. Develop architectures that support complex NLP tasks without relying on generalized AI or LLMs. NLP and Algorithm Development: Implement bespoke NLP algorithms tailored for question answering. Develop and integrate algorithms for syntax parsing, semantic analysis, and context understanding. Optimize algorithms for speed, accuracy, and resource efficiency. Data Management and Processing: Design and implement data ingestion and preprocessing pipelines. Ensure efficient handling of structured and unstructured data sources. Manage large datasets and implement data cleaning and transformation techniques. Technical Capabilities: Proficiency in NLP techniques such as tokenization, entity recognition, dependency parsing, and sentiment analysis. Experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and NLP libraries (spaCy, Stanford NLP). Familiarity with rule-based systems for natural language understanding. Knowledge of non-LLM approaches to NLP, such as LSTMs, seq2seq or ensemble methods. Experience with data querying languages (SQL, NoSQL) and familiarity with ETL (Extract, Transform, Load) processes. Understanding of RESTful API integration for data sourcing and algorithm deployment.Job tags
Salary
