Skillety
Location
Secunderabad | India
Job description
Education Qualifications:
B.Tech /BE from CS/IT or any other Engineering branch with the following skills and experience,
Minimum of 7 years of data experience - any combination of SQL, Data warehousing, BigData, Streaming etc.
Minimum 4 years of experience with distributed data processing frameworks - Apache Spark, Amazon EMR, Hadoop
Solid hands-on working experience in at least 4 or more of the following technologies:
Apache Spark
Kafka
EMR
Elastic search Stack
Apache Druid
Airflow
Nifi
Cassandra
Janus Graph
AWS Lambda
AWS Kinesis
Demonstrable expertise with Python, Spark, and wrangling of various data formats - Parquet, CSV, XML, JSON
Experience with batch and stream processing
Experience with building large scale data processing systems
Solid understanding of data design patterns and best practices
Working knowledge of data visualization tools such as Tableau, PowerBI, Apache Superset or Looker is a plus
Experience in analyzing data to identify deliverables, gaps, and inconsistencies in data sets
Experience running production data pipelines, processing frameworks and data architectures
Strong knowledge of ELT/ETL processes, data engineering experience
Knowledge of scripting or programming Bash, Python is a plus.
Knowledge of a configuration management tool, such as Ansible.
Deep, hands-on experience with Linux and administration
A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done.
Experience in production support and troubleshooting
Others :
Excellent Communication skills both Oral and Written
Excellent Team Co-ordination and ability to work with cross-functional teams of developers and testers.
Desirable to have exposure working in IOT domains
Self-motivator and motivate and support other team members.
Job tags
Salary
