Quantiphi
Location
Bangalore | India
Job description
Role:
Senior Data Engineer Experience Level: 4 to 6 Years Work location: Mumbai/Bangalore/Trivandrum What you’ll do: As a Senior Data Engineer, you will build utilities that would help architect & develop GCP solutions. You would build data processing scripts and pipelines that serve several jobs and queries per day. The services you build will integrate directly with cloud services, opening the door to new and cutting-edge re-usable solutions. You will work with engineering teams, co-workers, and customers to gain new insights and dream of new possibilities. You will be working to automate the job workflow, testing scenarios and data monitoring. The GCP Data Engineering team is hiring in the following areas: Distributed storage and compute solutions ,Data ingestion, consolidation, and warehousing , Cloud migrations and replication pipelines and in-cloud Big Data solutions, Big Data, Hadoop and spark processing. Role & Responsibilities: ● Work with cloud engineers and customers to implement cloud solutions by developing utilities for migration, storage and processing on GCP Cloud. ● Design and build a cloud migration strategy for cloud ● Automate the job workflow, testing scenarios and data monitoring processes ● Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact at massive scale ● Understanding of Informatica and IDMC ● Communicate with a wide set of teams, including Infrastructure, Network, Engineering, DevOps, SiteOps teams, and cloud customers ● Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple cloud clusters Required Skills: ● 4+ years’ experience of Hands-on in data structures, distributed systems, GCP and spark, SQL ● Experience in Informatica and IDMC ● Experience in GCP Big Query, GCP Cloud SQL and Cloud Composer skills along with sql scripting, GCP Cloud Dataflow. ● Experience building and deploying cloud-based solutions at scale. ● Experience in developing Big Data solutions (migration, storage, processing) ● Experience building and supporting large-scale systems in a production environment Technology Stack: ● Cloud Platforms – GCP ● Informatica and IDMC ● Experience in SQL and PythonJob tags
Salary
