Job Description

Active contributor to code development in projects and services.

 Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products.

 Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality and performance.

 Responsible for implementing best practices around systems integration, security, performance and data management.

 Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape.

 Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions.

 Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects and strategic internal and external partners.

 Develop and optimize procedures to productionalize data science models.

 Define and manage SLAs for data products and processes running in production.

 Support large-scale experimentation done by data scientists.

 Prototype new approaches and build solutions at scale.

 Research in state-of-the-art methodologies.

 Create documentation for learnings and knowledge transfer.

 Create and audit reusable packages or libraries.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

6+ years of overall technology experience that includes at least 4+ years of hands-on software development, data engineering, and systems architecture.

 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools.

 4+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.).

 2+ years in cloud data engineering experience in Azure.

 Fluent with Azure cloud services. Azure Certification is a plus.

 Experience with integration of multi cloud services with on-premises technologies.

 Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines.

 Experience with data profiling and data quality tools like Apache Griffin, Deequ, and Great Expectations.

 Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.

 Experience with at least one MPP database technology such as Redshift, Synapse or SnowFlake.

 Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes.

 Experience with version control systems like Github and deployment & CI tools.

 Experience with Azure Data Factory, Azure Databricks and Azure Machine learning tools.

 Experience with Statistical/ML techniques is a plus.

 Experience with building solutions in the retail or in the supply chain space is a plus

 Understanding of metadata management, data lineage, and data glossaries is a plus.

 Working knowledge of agile development, including DevOps and DataOps concepts.

 Familiarity with business intelligence tools (such as PowerBI).

 BA/BS in Computer Science, Math, Physics, or other technical fields. Bachelors degree in IT or related field

 Python Flask, SQL

 Experience working with customer data and consumer goods

 Scan data, market share or within these companies: Circana, IRI, NPD or Nielsen null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.