Advansoft
Location
Jaipur | India
Job description
Big Data Engineer Duties & Responsibilities :- Work with Big data development team, business stakeholders, DBAs, system administrators, data modeling teams for Data pipeline build and design.- Translate business requirements into technical requirements.- Understanding of data quality methodologies and data governance to ensure standardization of data is maintained.- Contribute to the requirements analysis process, associate in creating architecture and design documents.- Design, develop and test data flows using spark/ pyspark.- Perform data science work for analytics.- Determine optimal approach for obtaining data from diverse source systems.- Be a key contributor to initiatives that require technical expertise.- Work closely with the team responsible for maintaining the data model, including- data dictionary/metadata registry.- Possess expertise in project migration and release coordination activities.- Interface with business stakeholders to understand requirements and offer solutions.Skill Set and Qualification :- At least six (6) years of experience in working with Big data tools and technology.- Experience with Hadoop, Python, Spark/Pyspark, Hive and Tableau/Heavy.ai.- Strong exposure working with web service sources/Targets, XML Sources and Restful API's.- Experience with Linux / shell scripting complementary with ETL tool.- At least two (2) years of experience in performance tuning.- Exposure working with relation databases Oracle, My SQL & SQL Server including complex SQL constructs and DDL generation.- Experience in managing and deploying applications in Cloud Platform.- Strong knowledge of relational databases and experience with SQL scripting / stored procedures in PL/SQL.- Experience with data modeling and data mapping design.- Bachelor's degree in Computer Science, Information Systems, or equivalent education or work experience. (ref:hirist.tech)
Job tags
Salary
