logo

JobNob

Your Career. Our Passion.

Data Engineer


D. E. Shaw India Private Limited


Location

Gurgaon | India


Job description

We are looking for bright and exceptional candidates for Data Engineer role within our product development teams based out of Hyderabad. At DESIS, the Data Engineers develop Web Robots or Web Spiders that crawl through the web, retrieve data in the form of html, plain text, pdfs, excel, and any other format that is either structured or unstructured. The job functions of the engineer also include scraping the website data into structured format, building automated and custom reports on the downloaded data that is used as a knowledge for business purposes. The team also works on automating end to end data pipelines.

What you'll do day-to-day

As a member of the Data Engineering team, you'll be responsible for various aspects of data extraction such as understanding the data requirements of the business group, reverse engineer the website, its technology and data retrieval process, re-engineer by developing web robots to automate the extraction of the data and build monitoring systems to ensure the integrity and quality of the extracted data. You'll also be responsible for managing the changes to the website dynamics/layout to ensure clean downloads, build scraping and parsing systems to transform raw data into structured form and offer operations support to ensure high availability and zero data losses. You'll also be included in other tasks such as storing the extracted data in the recommended databases, building high-performing, scalable data extraction systems and automating data pipelines.

Who we're looking for

At theD.E.Shaw group, we believe the diversity of our employees is core to our strength and success. We are committed to supporting our people in work and in life, which is why we offer benefits such as a family planning and surrogacy program and a charitable gift match to all full-time employees.

Additionally, our staff-led affinity groups are pillars of our community, helping to celebrate diversity, promote leadership and development opportunities, and facilitate inclusive mentorship. Members and allies organize a wide range of educational and social programming, from expert talks to film festivals.

Candidates with relevant experience looking to restart their careers after a break are encouraged to apply for this position.

The members of the D.E.Shaw group do not discriminate in employment matters on the basis of race, color, religion, gender, gender identity, pregnancy, national origin, age, military service eligibility, veteran status, sexual orientation, marital status, disability, caregiver status, or any other category protected by law. We are committed to the principles of diversity, equity, and inclusion, and are eager to hear from individuals having a wide range of backgrounds and personal characteristics.

Candidates who are residents of California (any such candidate, a 'California Resident') should click for our CCPA Recruitment Personal Information Privacy Notice.

The D.E.Shaw group may collect, use, hold, transfer, and process candidates' resumes and associated information (including personal information contained therein) for purposes reasonably related to their application, including without limitation: review and management of employment applications and supporting materials administration and management of offers to and communication with candidates and administration, management, and improvement of the recruiting operations of the D.E.Shaw group and/or where reasonably required in connection with a proposed sale, spin-out, reorganization, or outsourcing of all or some of the business of the D.E.Shaw group. The D.E.Shaw group will not use such information for purposes unrelated to the foregoing, such as direct marketing of third-party products to candidates, without candidate consent. As used herein, the term 'personal information' is meant to broadly describe information identifying or relating to a specific individual it is intended to encompass 'personal data,' 'sensitive personal data,' and 'personally identifiable information' and similar terms, as those terms are defined by law in the jurisdictions in which the D.E.Shaw group operates.

The D.E.Shaw group may transfer such personal information within and outside the country and jurisdiction of the locations where the D.E.Shaw group maintains offices, to other D.E.Shaw group affiliates, to government and regulatory authorities, and to third parties which provide or may provide support and/or services to the D. E. Shaw group and for the purposes set forth above. The persons who may have access to this personal information are other employees of the D.E.Shaw group, in connection with the performance of their duties of employment, and the other parties listed above, in connection with the business of the D.E.Shaw group. (Of course, candidates will be considered for employment opportunities only in those countries in which they express interest.)

The D.E.Shaw group will use reasonable care to maintain the confidentiality of personal information (including appropriate technical measures against unauthorized or unlawful processing and against accidental loss or destruction of, or damage to, such information) and will retain such data as required by applicable law or regulation. Candidates have the right to request access to, and correction of, their personal information in accordance with applicable law any such request should be submitted to . Candidates who have submitted a resume to the D.E.Shaw group and do not wish to proceed with their applications should email . Personal information of candidates who have been the subject of background checks may have been transferred in accordance with applicable regulations, and any concerns with such transfers should be submitted to .

TheD.E.Shaw group may retain candidates' information for prospective recruiting activities, including sourcing candidates for employment opportunities and for organizing events with prospective candidates, in accordance with our internal data retention procedures. Candidates who do not agree to such future use should email .

COPYRIGHT © 2018-2024 D.E.SHAW & CO., L.P. ALL RIGHTS RESERVED

Registered:

Plot No. 573, B & C, Road No. 1

Jubilee Hills, Hyderabad 500 096

Telangana, India


Job tags



Salary

All rights reserved