www.starof.com
Location
Hyderabad | India
Job description
Job Description : We are hiring for a Data Engineer, with a focus on designing and implementing scalable data solutions :Mandatory AI/ML experience one year along with below skills :Strong programming skills in languages like Python, Java, or ScalaExperience with big data technologies (Hadoop, Spark) ETL tools, and data warehousing solutionsProficiency in both relational and NoSQL databaseSolid understanding of data modeling concepts and best practicesExtensive experience with distributed data processing using Spark for large-scale data transformationsFamiliarity with tools like HDFS MapReduce, and Hive for processing and storing big dataUnderstanding and implementation of serverless computing using services like AWS Lambda or Azure functions for data processingExpertise in designing, implementing, and optimizing cloud-based data warehousesProficiency in managing and optimizing cloud-based relational databases and NoSQL databasesExperience with cloud-based ETL services like AWS Glue, Azure Data Factory, or Google Cloud Dataflow for orchestrating data workflowsKnowledge of streaming data processing using services like AWS Kinesis, Azure Stream Analytics, or Apache Kafka on cloud platformsImplementing and managing data security measures, access controls, and ensuring compliance with data governance standards on cloud platformsFamiliarity with tools like AWS CloudFormation or Azure Resource Manager for defining and provisioning cloud infrastructureProficiency in interacting with services like AWS Lake Formation or Azure Data Lake StorageSetting up monitoring and logging solutions (e.g., AWS CloudWatch, Azure Monitor) for tracking the performance and health of data pipelinesAbility to optimize and manage costs associated with cloud resources, utilizing tools like AWS Cost Explorer or Azure CostExcellent problem-solving and analytical skillsProficiency in collaboration tools for version control (e.g., Git) and coordination within a teamAbility to work effectively in a cross-functional team (ref:hirist.tech)
Job tags
Salary
