Specialty Development Practitioner
FastSwitch - Great Lakes Pvt Ltd.
Location
India | India
Job description
The Data Insights & Analytics team and Customer 360 team is seeking resources to be part of development team to: Design, build, operationalize, secure, audit logging, monitor, re-usable and manageable data processing systems, both batch and streaming on GCP to modernize data warehouses, data lakes and data marts all while assuring low latency, high throughput, availability, durability, stability, and scalability.
- Strong data engineering experience using Java programming languages using Google Cloud data processing frameworks. Should have worked on handling big data.
- Work as part of an implementation team from concept to end to end solution including operations, offering deep technical subject matter expertise on various GCP services for effective deployment.
- Thorough understanding on ETL vs ELT approaches to modernize Datawarehouse and custom data products.
- Thorough knowledge on data warehouse/ data model concepts to build reliable and optimal data solutions.
- Pair with other team members and Guide/Train them as part of Design and Implementation
Skills Required Data Engineer Design and build production data engineering solutions to deliver data pipeline patterns using following Java with Google Cloud Platform (GCP) services:
- In-depth understanding of Google's product technology and underlying architectures
- BigQuery – Warehouse/ data marts – Through understanding of Big Query internals to write efficient queries for ELT needs, creation of views/materialized views, creation of reusable store procedures etc.
- DataFlow Data Proc Cloud Data Fusion
- Pub/Sub, Kafka, Confluent Kafka – Real time streaming of database changes or events.
- Experience of designing, building, and deploying production-level data pipelines using Kafka; Strong experience working on Event Driven Architecture
- Experience in handling huge volumes of data usinf Big Table & Big Query
- Cloud SQL, Compute Engine, Cloud Function, Cloud Run and App Engine, Cloud Storage
- Experience with open-source distributed storage and processing utilities in the Apache Hadoop family.
- Extensive knowledge on processing various file formats orc, Avro, csv, json, xml etc.
- Knowledge/experience in any ETL tools like DataStage/Informatica – Ability to understand existing on-premises ETL workflows and redesign them in GCP.
- Experience and expertise on Terraform to deploy the GCP's in CI/CD.
Skills Preferred Data Engineer with JAVA GCP experince in Design and build production data engineering solutions to deliver data pipeline patterns using following Google Cloud Platform (GCP) services:
- In-depth understanding of Google's product technology and underlying architectures
- BigQuery – Warehouse/ data marts – Through understanding of Big Query internals to write efficient queries for ELT needs, creation of views/materialized views, creation of reusable store procedures etc.
- DataFlow Data Proc Cloud Data Fusion
- Pub/Sub, Kafka, Confluent Kafka – Real time streaming of database changes or events.
- Experience of designing, building, and deploying production-level data pipelines using Kafka; Strong experience working on Event Driven Architecture
- Experience in handling huge volumes of data usinf Big Table & Big Query
- Cloud SQL, Compute Engine, Cloud Function, Cloud Run and App Engine, Cloud Storage
- Experience with open-source distributed storage and processing utilities in the Apache Hadoop family.
- Extensive knowledge on processing various file formats orc, Avro, csv, json, xml etc.
- Knowledge/experience in any ETL tools like DataStage/Informatica
- Ability to understand existing on-premises ETL workflows and redesign them in GCP.
- Experience and expertise on Terraform to deploy the GCP's in CI/CD.
Experience Required - 5 to 8 years 1.5 years of experience in Java , GCP (DataProc DataFusion Big Query and Big Table ) Rest in any ETL tools like Informatica / DataStage
Experience Preferred: Java GCP
Education Required: MCA/BE/B.Tech/MSC/M Tech
Additional Info At FastTek Global,
Our Purpose is
Our People and
Our Planet . We come to work each day and are reminded we are
helping people find their success stories . Also,
Doing the right thing is our mantra . We act responsibly, give back to the communities we serve and have a little fun along the way.
We have been doing this with pride, dedication and plain, old-fashioned hard work for
24 years !
FastTek Global is financially strong, privately held company that is
100% consultant and
client focused .
We've differentiated ourselves by being
fast, flexible, creative and
honest . Throw out everything you've heard, seen, or felt about every other IT Consulting company. We do unique things and we do them for Fortune 10, Fortune 500, and technology start-up companies.
Benefits Our benefits are second to none and thanks to our
flexible benefit options you can choose the benefits you need or want, options include:
- Medical and Dental (FastTek pays majority of the medical program)
- Vision
- Personal Time Off (PTO) Program
- Long Term Disability (100% paid)
- Life Insurance (100% paid)
- 401(k) with immediate vesting and 3% (of salary) dollar-for-dollar match
Plus, we have a lucrative employee referral program and an employee recognition culture.
FastTek Global was named one of the
Top Work Places in Michigan by the Detroit Free Press in
2013, 2014, 2015, 2016, 2017, 2018, 2019 ,
2020, 2021, and 2022! To view all of our open positions go to:
Follow us on Twitter:
Follow us on Instagram:
Find us on LinkedIn:
You can become a fan of FastTek on Facebook:
Job tags
Salary