Description We are seeking a Data Engineer for a long-term contract opportunity in Chicago, Illinois. The successful candidate will be an integral part of our team, leveraging their expertise in Azure Databricks, Azure Data Factory, and Synapse, among other tools. This role is central to our data management and analysis operations, contributing to the optimization of data ingestion, processing, and consumption.

Responsibilities:

• Develop and implement Medallion Architectures (Bronze, Silver, Gold) to enhance data ingestion, processing, and consumption.

• Design, construct, and maintain efficient, scalable, and reliable data pipelines utilizing Azure Databricks, Azure Data Factory, Azure Synapse, or Microsoft Fabric.

• Utilize Spark SQL, Python, and Scala (optional) programming optimized for Azure Databricks.

• Facilitate CI/CD with Azure DevOps for source control, code management, and deployment to environments (i.e. dev/test/prod).

• Work with Unity Catalog and connect Azure Databricks to Power BI, if needed.

• Collaborate effectively with a global (onshore/offshore) development team.

• Leverage skills in Apache Kafka, Apache Pig, Apache Spark, Cloud Technologies, Data Visualization, Algorithm Implementation, Analytics, Apache Hadoop, API Development, AWS Technologies, Azure Databricks, Azure Data Lake, and Azure SQL Database.

• Manage customer applications and records, while resolving any customer inquiries.

• Monitor customer accounts and take appropriate action when necessary. Requirements • Proven experience as a Data Engineer or similar role in a data-focused environment for at least 7 years

• Proficiency in Apache Kafka, Apache Pig, and Apache Spark

• Experience with cloud technologies such as AWS Technologies, Azure Databricks, Azure Data Lake, and Azure SQL Database

• Strong knowledge of data visualization techniques and tools

• Ability to implement complex algorithms and analytics

• Experience in Apache Hadoop and API development is essential

• Familiarity with data architecture principles and best practices

• Excellent problem-solving skills and attention to detail

• Strong communication skills with the ability to present complex data-related concepts to non-technical stakeholders

• Bachelor's degree in Computer Science, Data Science, or a related field is preferred. Technology Doesn't Change the World, People Do.®

Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

© 2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .