logo

JobNob

Your Career. Our Passion.

Big Data Architect


Rishabh RPO


Location

Provincia di Reggio nell'Emilia | Italy


Job description

Title: Big Data Architect

Location: Washington DC

Duration: 12 Months Possible Extension

Pay Rate: $90/Hr

The ideal candidate has 16 years of experience planning coordinating and monitoring project activities in an enterprise environment 5 years of knowledge of Big Data Data Architecture and Implementation best practices and 10 years of knowledge of Datacentric systems for the analysis and visualization of data such as Tableau MicroStrategy ArcGIS Kibana and Oracle

Position Description: This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government including the Internet of Things (IoT) / Smart City projects enterprise data warehouse the open data portal and data science applications. This is an exciting opportunity to work as a part of a collaborative senior data team supporting DCs Chief Data Officer. This architecture includes Databricks Microsoft Azure platform tools (including Data Lake and Synapse) Apache platform tools (including Hadoop Hive Impala Spark Sedona and Airflow) and data pipeline/ETL development tools (including Streamsets Apache NiFi Azure Data Factory). The platform will be designed for Districtwide use and integration with other OCTO Enterprise Data tools such as Esri Tableau MicroStrategy API Gateways and Oracle databases and integration tools.

Position Responsibilities:

Skill Required / Desired Amount of Experience Candidate
Experience implementing Big Data storage and analytics platforms such as Databricks and Data Lakes Required 5 Years
Knowledge of Big Data and Data Architecture and Implementation best practices Required 5 Years
Knowledge of architecture and implementation of networking security and storage on cloud platforms such as Microsoft Azure Required 5 Years
Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure Required 5 Years
Knowledge of Datacentric systems for the analysis and visualization of data such as Tableau MicroStrategy ArcGIS Kibana Oracle Required 10 Years
Experience querying structured and unstructured data sources including SQL and NoSQL databases Required 5 Years
Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines Required 5 Years
Experience with implementing Apache data products such as Spark Sedona Airflow Atlas NiFi Hive Impala Required 5 Years
Experience with API / Web Services (REST/SOAP) Required 3 Years
Experience with complex event processing and realtime streaming data Required 3 Years
Experience with deployment and management of data science tools and modules such as JupyterHub Required 3 Years
Experience with ETL data processing analytics using languages such as Python Java or R Required 3 Years
Experience with Cloudera Data Platform Highly desired 3 Years
16 yrs planning coordinating and monitoring project activities Required 16 Years
16 yrs leading projects ensuring they are in compliance with established standards/procedures Required 16 Years
Bachelors degree in IT or related field or equivalent experience Required


Job tags



Salary

All rights reserved