Data Architect/Lead Data Engineer - W5708
Location
Secunderabad | India
Job description
Nisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto ' Building Success Together® ,' Nisum has grown to over 1,800 professionals across the United States, Chile,Colombia, India, Pakistan and Canada. A preferred advisor to leading Fortune 500 brands, Nisum enables clients to achieve direct business growth by building the advanced technology they need to reach end customers in today's world, with immersive and seamless experiences across digital and physical channels. What You'll Do - Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity. Working as an individual contributor while leading the data team
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organisation.
- Lead and drive the team to deliver solutions on time and quality that committed.
- Write unit/integration tests, contributes to engineering wiki, and documents work.
- Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
- Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
- Work closely with all business units and engineering teams to develop a strategy for long term data engineering platform architecture
- Design of data-oriented solutions (end to end) using design patterns and best market practices.
- Define and implement governance, access and security policies
- Ensure optimal use of resources both in cost and performance
- Ensure that non-functional requirements are taken care
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
What You Know - A minimum of 10 years of ETL and Data Engineering experience.
- Experience in solutions architect or senior data engineer roles, in the design of data-intensive solutions (streaming, batch, migrations)
- Experience in modern data ingestion processes (datalake, datawarehouse, lakehouse)
- Experience in data governance models
- Experience with relational SQL and NoSQL databases.
- Experience with Azure cloud Data services
- More than 8 years of experience in a Data Engineering & ETL Tools (like Teradata, Ab Initio) and Azure
- Data Engineer with Azure functions and Azure Data Factory, Databricks and PySpark
- Experience with object-oriented/object function scripting languages: Python, Scala, etc.
- Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.
Education - A bachelor's degree in information technology, software development management, software engineering, computer science, or a related field.
Benefits - In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
- Continuous Learning - Year-round training sessions are offered as part of skill enhancement certifications sponsored by the company on a need basis. We support our team to excel in their field.
- Parental Medical Insurance - Nisum believes our team is the heart of our business and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
- Activities -From the Nisum Premier League's cricket tournaments to hosted Hack-a-thon, Nisum employees can participate in a variety of team-building activities such as skits, and dances performance in addition to festival celebrations.
- Free Meals - Free snacks and dinner is provided on a daily basis, in addition to subsidized lunch.
Nisum is an Equal Opportunity Employer and we are proud of our ongoing efforts to foster diversity and inclusion in the workplace.
Job tags
Salary