Description

The Databricks Engineer will work with stakeholders to design and develop data-oriented solution architecture involving On-Prem and cloud (Microsoft Azure) technologies. The candidate will collaborate with diverse teams necessitating superb interpersonal, communicative, customer service, time management, planning, and organizational abilities. A strong capacity for analysis and problem-solving is essential. Candidates with Databricks certifications are highly preferred. They are using lake houses that are already set up and creating pipelines to gather data and send it out using an API. They have a developer on the API side they will be paired with. Everything is done on Azure. They will be working on a team for a product that will be empowering a new energy experience. They are packaging data (example he gave was metering data for millions of customers). This product is under a non-disclosure, so he could not give a lot of details Responsibilities: • Data Pipeline Development: Design and develop robust data pipelines to ingest, store, and process data from various sources. • Data Modeling: Create and maintain data models that support data analysis and reporting. These models help organize and structure data for efficient querying and visualization. • ETL Processes: Build and maintain Extract, Transform, Load (ETL) processes. These processes move data between systems, ensuring data quality and consistency. • Communicate effectively and timely with customers, team members, and management • Provide timely, consistent, effective production application support • Ensure required documentation for projects is developed • Adhere to Change Management policies and procedures • Respond/Resolve quickly & effectively to all operational problems • Be a student of the business, taking care to understand the challenges & goals of our company

Skills

Databricks, azure, CosmosDB, etl, ssis, Azure Event Hub, Azure Storage, Azure Key Vault, agile, power bi, devops, ci/cd, architecture

Top Skills Details

Databricks,azure,CosmosDB,etl,ssis,Azure Event Hub,Azure Storage,Azure Key Vault

Additional Skills & Qualifications

Additional Skills (These are "Nice to Haves" but the hiring manager let us know these are borderline requirements): • Experience with Agile as well as DevOps, CI/CD methodologies- The team operates in an Agile environements, so having Agile experience while not a MUST have it is a STRONG nice to have. • Certifications are a BIG advantage as well: Anything related to Databricks or Azure - Engineering, Architecture, ETL, etc. • Experience with PowerBI for data visualization and reporting • Data Engineering Tools: Familiarity with tools like Apache Spark and Delta Lake. • Python Experience- They operate pretty much fully in this language Additional Skills: • Knowledge of cloud PaaS architecture & resources. • Hands-on experience designing and developing solutions involving data sourcing, enrichment and delivery using APIs & Web Services. • Excellent root cause analysis & problem-solving skills • Knowledge and understanding of software development technologies, methodology and associated tools • Strong project management skills including the ability to effectively organizes tasks, manages multiple priorities/details, and meets tight deadlines • Strong oral and written communication skills • Effective consulting skills with proven ability to influence others • Builds productive relationships with a focus on cooperation & teamwork • Experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions. • Experience with performance tuning techniques in a lakehouse environment, such as partitioning, aggregations, materialized views, etc. • Ability to build relationships and work with all levels of management, vendors, and other internal and external groups • Experience leading and managing technology projects including coordinating resources and tasks across multiple teams and business units. • Experience developing complex logical and physical data models

Experience Level

Expert Level

Pay and Benefits

The pay range for this position is $80.00 - $92.00/hr.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: • Medical, dental & vision• Critical Illness, Accident, and Hospital• 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available• Life Insurance (Voluntary Life & AD&D for the employee and dependents)• Short and long-term disability• Health Spending Account (HSA)• Transportation benefits• Employee Assistance Program• Time Off/Leave (PTO, Vacation or Sick Leave)

Workplace Type

This is a hybrid position in Atlanta,GA.

Application Deadline

This position is anticipated to close on Mar 18, 2025.

About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.