Agilisium Consulting
Location
Chennai | India
Job description
Key Qualifications: 5+ Years of experience in Data Engineering
· Proficient in AWS, SQL, Snowflake, Airflow, Pyspark and Python · 6+ years of experience in data engineering and ETL pipeline development. · 6+ years of experience in Big Data Technologies and Interacting with external API to pull data . · Experience on Kubernetes, Docker preferred. Description: • Develop and automate large scale, high-performance, scalable platform (batch and/or streaming) to drive faster analytics • Ability to design large-scale, complex applications and frameworks with excellent run-time characteristics such as low-latency, fault-tolerance and availability • Experience in building and maintaining custom frameworks to support engineering/analytics needs • Knowledge of continuous integration, testing methodologies, TDD and agile development methodologies. • Good knowledge of Data formats (Parquet, ORC etc.) and consensus management systems • Experience working with Media API (Facebook Graph API, GA, Segment, Google Ad Words, Pinterest , Snapchat) • Deploy inclusive data quality checks to ensure high quality of data.Job tags
Salary
