Sriven Systems, Inc
Location
Remote | United States
Job description
Good Morning
Please share me the updated resume as per client requirement [email protected]
H1B transfers & W2
Sr Data Engineer
100% remote
6 month contract
5 OPENINGS!!!
Top Skills - Must Haves
Spark
Scala
Cloud
Gcp
Apache Airflow
Airflow
Top Skills' Details
The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks.
Must-Haves
5-10 years of:
Scala programming language expertise
Spark framework expertise
Experience working with BigQuery
Familiarity scheduling jobs in Airflow
Fluency with Google Cloud Platform, in particular GCS and Dataproc
Secondary Skills - Nice to Haves
pyspark
dataflow
python
Scalding
Apache Beam
Job Description
About The Team
Batch Engines supports the batch Big Data tools for engineering teams at Etsy. As an infrastructure team, our goal is to ensure state of the art tools are easy to use and interface well within the Etsy engineering ecosystem to enable batch data processing. We are a 6 person team with expertise in Big Data and DevOps.
About The Role
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for:
Analyzing existing data pipelines to understand their architecture, dependencies, and functionality.
Working closely with data engineers to develop a migration strategy for converting pipelines from the current framework to the target framework.
Designing, building, and testing new data pipelines in the target framework, ensuring they meet or exceed existing performance and reliability standards.
Debugging and troubleshooting issues that arise during the migration process, working collaboratively with cross-functional teams to resolve them quickly.
Communicating progress, challenges, and timelines to stakeholders on a regular basis.
Additional Skills & Qualifications
Nice to Have:
Python programming language fluency
Scalding framework fluency
Pyspark framework fluency
Dataflow(Apache Beam) framework fluency
Employee Value Proposition (EVP)
100% remote, flexible time, as long as candidate can work during Etsy core hours (11 am - 2 pm EST)
Thanks & Regards,
Arjun K
Accounts Manager - Recruitment
Sriven Systems, Inc
Direct : 6313156999 / Ext : 1005
Mobile- +1 (951)-299-5015
F: 516-908-3640
545 S. Kimball avenue, Suite 100, Southlake, TX 76092 (New Address)
Winner of "Inc 500 & Inc 5000: Fastest Growing Companies in America" " 8 years in a Row : 2008 to 2016".
1999 2023: 23 + years of Excellence
Job tags
Salary
