Big Data Engineer

Location

Provincia di Reggio nell'Emilia | Italy

Job description

Job Title: Big Data Engineer

Experience Required: 3 years postcollege

Location : Remote ( MUST be comfortable with working in Eastern Time (USA) )

Budget :USD per month

Company Overview:

Our client is a pioneering firm in the cryptocurrency investment sector leveraging artificial intelligence to empower investors worldwide. With an expansive reach spanning over 50 countries they provide innovative solutions including crypto indices rankings and price predictions catering to a diverse clientele ranging from retail investors to crypto fund managers.

Position Overview:

We are seeking a dynamic and versatile Big Data Engineer to drive the efficiency of our Data Scientists and Engineering team. The successful candidate will play a pivotal role in constructing robust frameworks utilizing an array of tools and techniques including SQL Python R Java and C. Proficiency in machine learning techniques will be essential for crafting and maintaining data analysis structures while ensuring alignment with prevailing programming and deployment methodologies. Collaboration with colleagues is key throughout the process to ensure project needs are met effectively.

Key Responsibilities:

• Collaborate with team members and clients to elucidate project requirements.
• Develop infrastructure for accessing and analyzing big data efficiently.
• Optimize existing frameworks to enhance performance.
• Conduct thorough testing to validate the functionality of developed structures.
• Construct data pipelines from diverse sources utilizing varied data types (e.g. API CSV JSON).
• Prepare raw data for manipulation by Data Scientists.
• Implement robust data validation and reconciliation methodologies.
• Ensure data backups and accessibility for relevant stakeholders.
• Stay abreast of industry standards and technological advancements to enhance work quality.

Qualifications:

• Bachelors degree in Data Engineering Big Data Analytics Computer Engineering or related field.
• Masters degree in a relevant field is preferred.
• Proficient in airflow
• 3 years of experience in Python Java or any programming language development.
• 3 years of experience with SQL & NoSQL databases (experience with Snowflake Cloud DW & MongoDB is advantageous).
• Proficient in schema design and dimensional data modeling.
• Expertise in SQL NoSQL Python C Java and R.
• Experience in building Data Lakes Data Warehouses or equivalent solutions.
• Proficiency in AWS Cloud services.
• Strong analytical and problemsolving abilities.
• Ability to work independently and collaboratively within a team.
• Effective management of multiple tasks with minimal supervision.

If you are passionate about leveraging cuttingedge technology to drive innovation in the cryptocurrency investment space we encourage you to apply and be part of our dynamic team dedicated to revolutionizing the industry.

MUST be comfortable with working in Eastern Time (USA)

Notice Period: Immediate joiner to max 15 days

big data,airflow,python,sql,aws

Job tags

Salary