Location
São Paulo, SP | Brazil
Job description
A fast-growing company that is developing a world-class regulated multi-asset trading platform is looking for a Senior Data Engineer. The engineer will be responsible for combining strong analytical abilities, a solid understanding of business, and superior data engineering capabilities to provide the organization with the benefits that are anticipated. The company is determined to introduce revolutionary solutions and technologies to the FinTech industry. This is an amazing opportunity for developers who are eager to enhance the caliber of data-based decisions made across the organization while utilizing cutting-edge technology in a cloud-based environment in a multidisciplinary team of analysts, data scientists, data engineers, and SMEs.
Job Responsibilities:
- Provide a platform and support system for data analytics that will make it simple and standard to access and share data
- Take charge of the information architecture, and how it can be evolved to support business strategy and functional requirements
- Explore and use Databricks, Azure Events Hub, Azure Data Lake, and Synapse
- help with developing, and maintaining data pipelines for numerous data sources and liaise with system owners
- Work with real-time data ingestion and transformations to support use cases
- Engage in on-call situations to assist with any catastrophic failures
- Support your ideas and help your teammates understand what you have learned
- Work with the Azure stack and establish a general understanding of the Data team's engineering efforts
- Take part in the on-call schedule for production support
- Play a key role in the Data transformation program, interfacing with the Governance, Data Science, Reporting and Business partnering teams
- Ensure that the transformation backlog is delivered for source systems, derived tables, and data products
- Analyze complicated data, then convey the results
- Integrate governance, quality data capabilities, and technologies to ensure data consistency
- Actively deliver new products and support BAU efforts with other senior and lead engineers
- Support ad hoc data requests and production issues
- Troubleshoot BAU-related issues, create JIRA issues, and work on process improvement
Job Requirements:
- Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
- At least 5+ years of relevant experience as a data engineer
- Prolific experience working with Python, SQL, and PySpark
- 9+ years of relevant expertise in the trading/financial services industry
- 9+ years of experience with Azure Data Factory
- Good political awareness, communication abilities, and judgment of priorities
- Strong debugging and problem-solving skills
- Vast experience in the creation of data pipelines, ETL processes, data warehousing, and big data processing that are effective and reliable.
- Working experience and understanding of Azure Databricks, Azure Events Hub, and Azure Data Lake
- Prolific experience with Azure Synapse and Azure SQL
- Previous Python framework programming experience
- Proven track record in business processing, data mapping, and analytics
- Knowledge of real-time development and corporate data modeling principles
- Nice to have Data Engineering certification in either Azure Data Engineer or Google Certified Professional
- Fluent in English, both conversational and written
Job tags
Salary
