Zallery
Location
Hyderabad | India
Job description
Job Description : - Proven experience as a Data Engineer, with a focus on designing and implementing scalable data solutions - Strong programming skills in languages like Python, Java, or Scala - Experience with big data technologies (Hadoop, Spark) ETL tools, and data warehousing solutions - Proficiency in both relational and NoSQL database - Solid understanding of data modeling concepts and best practices - Extensive experience with distributed data processing using Spark for large-scale data transformations - Familiarity with tools like HDFS MapReduce, and Hive for processing and storing big data - Understanding and implementation of serverless computing using services like AWS Lambda or Azure functions for data processing - Expertise in designing, implementing, and optimizing cloud-based data warehouses - Proficiency in managing and optimizing cloud-based relational databases and NoSQL databases - Experience with cloud-based ETL services like AWS Glue, Azure Data Factory, or Google Cloud Dataflow for orchestrating data workflows - Knowledge of streaming data processing using services like AWS Kinesis, Azure Stream Analytics, or Apache Kafka on cloud platforms - Implementing and managing data security measures, access controls, and ensuring compliance with data governance standards on cloud platforms - Familiarity with tools like AWS CloudFormation or Azure Resource Manager for defining and provisioning cloud infrastructure - Proficiency in interacting with services like AWS Lake Formation or Azure Data Lake Storage - Setting up monitoring and logging solutions (e.g., AWS CloudWatch, Azure Monitor) for tracking the performance and health of data pipelines - Ability to optimize and manage costs associated with cloud resources, utilizing tools like AWS Cost Explorer or Azure Cost - Excellent problem-solving and analytical skills - Proficiency in collaboration tools for version control (e.g., Git) and coordination within a team - Ability to work effectively in a cross-functional team (ref:hirist.tech)
Job tags
Salary
