Job Description

A large retail company is seeking a Data Engineer to join their team in Cincinnati, OH. This person will work in a hybrid work environment required to go on site two days/ week. They will be brought on to support a platform that has been built out in Azure Data Factory. Their main responsibilities will include the following.

Need to be very well versed in Databricks with Medallion Architecture - Moving from bronze to silver to gold then serving up in unity catalog

Develop and implement data pipelines for movement of data through the layers based on team & enterprise standards.

Implement & perform unit testing, system integration testing, regression testing and assist with user acceptance testing.

Adhere to established standards and best practices and provide input for improvement of those processes.

Self-motivated team player who can work with minimal supervision and can adapt to a quickly changing environment.

Ability to work on multiple tasks simultaneously, ability to switch between tasks and work in conflicting priorities.

Must have strong knowledge of Software Development Life Cycle including requirement analysis, design, development, testing, and implementation. Hands on experience in performance tuning of sources, targets, mappings, and sessions.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

4+ years of experience in a Data Engineering role

2-3 years of Hands on Experience working with in Azure Databricks including workflows, Delta Live Tables and Databricks Unity Catalog

Familiarity with ETL/ELT in Databricks and with Medallion architecture

SQL, PySpark, Python

Spark SQL Oracle Database Technologies

Kafka

Terraform

Databricks Certified Data Engineer Associate null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.