Morph Enterprise
Location
Ware, Hertfordshire | United Kingdom
Job description
100% ONSITE
The client seeks an experienced IT Consultant to support the design development implementation and maintenance of an enterprise Big Data solution as part of the Data Modernization Effort.
This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations including the Internet of Things (IoT) / Smart City projects enterprise data warehouse the open data portal and data science applications. This is an exciting opportunity to work as a part of a collaborative senior data team supporting Chief Data Officer. This architecture includes an Databricks Microsoft Azure platform tools (including Data Lake Synapse) Apache platform tools (including Hadoop Hive Impala Spark Sedona Airflow) and data pipeline/ETL development tools (including Streamsets Apache NiFi Azure Data Factory). The platform will be designed for use and integration with other Enterprise Data tools such as Esri Tableau MicroStrategy API Gateways and Oracle databases and integration tools.
Minimum Education/Certification Requirements: Bachelors degree in Information Technology or related field or equivalent experience
|
Skill | Required / Desired | Amount | of Experience |
|
Experience implementing Big Data storage and analytics platforms such as Databricks and Data Lakes | Required | 5 | Years |
| Knowledge of Big Data and Data Architecture and Implementation best practices | Required | 5 | Years |
| Knowledge of architecture and implementation of networking security and storage on cloud platforms such as Microsoft Azure | Required | 5 | Years |
| Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure | Required | 5 | Years |
| Knowledge of Datacentric systems for the analysis and visualization of data such as Tableau MicroStrategy ArcGIS Kibana Oracle | Required | 10 | Years |
| Experience querying structured and unstructured data sources including SQL and NoSQL databases | Required | 5 | Years |
| Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines | Required | 5 | Years |
| Experience with implementing Apache data products such as Spark Sedona Airflow Atlas NiFi Hive Impala | Required | 5 | Years |
| Experience with API / Web Services (REST/SOAP) | Required | 3 | Years |
| Experience with complex event processing and realtime streaming data | Required | 3 | Years |
| Experience with deployment and management of data science tools and modules such as JupyterHub | Required | 3 | Years |
| Experience with ETL data processing analytics using languages such as Python Java or R | Required | 3 | Years |
| Experience with Cloudera Data Platform | Highly desired | 3 | Years |
| 16 yrs planning coordinating and monitoring project activities | Required | 16 | Years |
| 16 yrs leading projects ensuring they are in compliance with established standards/procedures | Required | 16 | Years |
| Bachelors degree in IT or related field or equivalent experience | Required |
Job tags
Salary
