Technical Consultant, Data

Responsibilities:

A Data Engineer should be able to build, operationalize and monitor data processing systems

Create robust and automated pipelines to ingest and process structured and unstructured data from various source systems into analytical platforms using batch and streaming mechanisms leveraging cloud native toolset

Implement custom applications using tools such as Kinesis, Lambda and other cloud native tools as required to address streaming use cases

Engineers and supports data structures including but not limited to SQL and NoSQL databases

Engineers and maintain ELT processes for loading data lake (Snowflake, Cloud Storage, Hadoop)

Leverages the right tools for the right job to deliver testable, maintainable, and modern data solutions

Respond to customer/team inquiries and assist in troubleshooting and resolving challenges

Works with other scrum team members to estimate and deliver work inside of a sprint

Research data questions, identifies root causes, and interacts closely with business users and technical resources

Qualifications:

3+ years of professional technical experience

3+ years of hands on DBT experience.

3+ years of hands-on Data Warehousing.

3+ years of experience building highly scalable data solutions using Hadoop, Spark, Databricks, Snowflake

2+ years of programming languages such as Python

3+ years of experience working in cloud environments (Azure)

2 years of experience in Redshift

Strong client-facing communication and facilitation skills

Key Skills:

Python, Azure Cloud, Redshift, NoSQL, Git, ETL/ELT, Spark, Hadoop, Data Warehouse, Data Lake, Data Engineering, Snowflake, SQL/RDBMS, OLAP