Location
Secunderabad | India
Job description
Job Description
Background
Clarity Services, a part of Experian, is a credit bureau that provides reporting on near-prime, non-prime and subprime consumers. We are looking for a Senior Data Engineer to join the engineering team. This is a remote or in-office position.
We have about 15 terabytes of data in MySQL and MongoDB. We use Ruby, JRuby, and Elixir to run over a million transactions for our customers every day. Our typical response times are 1-2 seconds for a basket of products, and we maintain uptimes north of 99.99%.
Summary
This Data Engineer position will be responsible for architecting, designing and building the data pipelines to operationalize the data for use by our Analytics team. This position will be responsible for building a new data flow to be used for R&D, Reporting, and Data insights.
Responsibilities
- Implement best practices for the engineering team across code hygiene, overall architecture design, testing, and deployment activities.
- Drive technical decisions for building data pipelines, data lakes, and analyst access.
- Act as a leader within the engineering team, providing support and mentorship for teammates across functions.
Our environment
- All repositories kept up to the latest viable versions of Rails and Ruby
- Private Git/GitHub repository, Jira for ticket tracking/scrum sprints and GitHub for code reviews
- 1:1 test coverage for most of codebase and 2:1 for prime areas
- Mac laptops provided for development.
- Jenkins for continuous integration deploy to AWS.
- Agile teams comprised of Software Developers and Software Test Engineers
Qualifications
Requirements
- Bachelor's degree in computer science or equivalent job experience
- Experience building and optimizing 'big data' data pipelines, architectures and data sets.
- Experience with database technologies like Redshift, Synapse DW, Snowflake etc.
- Experience with BI Solutions like Looker, Power BI, Amazon Quicksight, Tableau etc.
- A successful history of manipulating, processing, and extracting value from large datasets.
- Experience using Git productively in a team environment.
- Experience with Docker
- Experience with Amazon Web Services
Additional Desired Skills
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Knowledge and Experience:
- Several years of python experience
- Excellent analytical and problem-solving skills
- Excellent organizational skills
- Proven verbal and written cross-department and customer communication skills.
Additional Information
Experian Careers - Creating a better tomorrow together
Job tags
Salary
