Consultant - Data Engineer
Location
Bokaro | India
Job description
Experience Level : 4-7 Years
Location: Bokaro
Notice Period: 15-30 days
Must Have Skills: DWH, Big Data, Data Analysis, Data Lake, ETL, PySpark/Spark, Python, SQL & Shell Scripting.
Responsibilities:
- Using Agile and DevOps methods, build platform architecture using a variety of sources (such as cloud IaaS/ SaaS).
- Integrate data from a variety of business subject areas: Leads management, Customer Portal, Seller App, SAP, Sales Force etc. (Depending on the requirement from client).
- Implement rules & automate data cleansing, mapping, transformation, logging, and exception handling.
- Design, build, and deploy databases and data stores.
- Participate in cross-functional teams to promote technology strategies, analyze and test products, perform proof-of-concept, and pilot new technologies and/or methods.
- Establish and document standards, guidelines, and best practices for teams utilizing the solutions.
- Review vendor solution designs to ensure technology appropriateness, standards compliance, and platform capacity alignment.
Skills and Expertise:
- 4+ years of overall experience with over 2+ years in Data Lake environment with designing and developing Big Data / Data Warehouse solutions.
- Strong Object-Oriented Programming concepts (OOPS) and good in Python (Backend coding).
- Strong knowledge of SQL and Database handling.
- Should be proficient in OS related activities like shell script /Pearl script/batch files on Server Side (Linux/Solaris) technologies.
- Expertise in developing features for enterprise scale systems will be an added advantage.
- Passion in being the technology ambassador and coaching engineering excellence to junior engineers.
- Strong understanding of the Software design/architecture/data-backed-decision-making processes.
- Understanding Docker/Kubernetes/CICD Pipeline.
- Knowledge of Steel manufacturing industry is preferable.
- Knowledge of any visualization tools like Power BI/MicroStrategy/Tableau/SSRS.
Job tags
Salary
