DE Jobs

Search from over 2 Million Available Jobs, No Extra Steps, No Extra Forms, Just DirectEmployers

Job Information

Insight Global Senior Engineer - Remote - Spark in Silver Spring, Maryland

Job Description

Position Objective:

You will work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for the data and analytics platform that allows users to, access data catalogs, request compute resources, and manage data access controls for an enterprise data and analytics platform

Responsibilities:

  * Building, iterating, and testing scalable, resilient back-end capabilities for a cloud-based developer platform that supports data analytics capabilities at scale

  * Support the self-service provisioning capabilities of a large, bring-your-own-data platform that provides high-end data analytics capabilities to a wide variety of technical users (developers, analysts)

  * Participating in Agile processes including daily standups, demos, retrospectives, and sprint planning

  * Working closely with leadership to gather and implement business requirements

  * Working closely with designers and engineers to gather and implement product, front-end, and back-end requirements

  * Providing support, maintenance, and enhancements to the existing application

  * Provide Subject Matter expertise to the user community in best-practices for configuring clusters, designing jobs and controlling costs of data pipelines

  * Guide customer in pricing feature sets based on the user community's usage patterns and data processing requirements

  * Collaborating with product managers, engineers, and QA on the team to communicate and clarify designs and requirements

Long term opportunity

40-70/h

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

   

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

Requirements

Education and Experience:

  * Bachelor's Degree or equivalent in experience in Engineering, Computer Science, or related field

  * 7+ years of experience in software application development, particularly in an agile development environment including but not limited to daily scrum, iteration reviews, Kanban/Lean, continuous integration and test-driven development

  * 3+ years of experience in AWS cloud data architecture

Qualifications:

  * 7+ years of software engineering experience

  * 5+ years of experience with Spark processing large datasets and optimizing data pipelines

  * Experience with Node.js, Rust, java

  * Python

  * Experience optimizing cloud costs

  * Deep understanding of APIs, and familiarity with JSON, Web APIs, REST APIs, JSON-RPC, XML-RPC, RESTful practices, and GraphQL

  * Experience with Docker containerization and deployments

  * Experience in relational and non-relational databases like SQL, MySQL, NoSQL, PostgreSQL, MongoDB or similar

  * Experience with benchmarking, monitoring, and performance engineering applications with tools such as Grafana, Sentry, New Relic and Prometheus

  * Knowledge of AuthN and AuthZ systems, including Active Directory, Okta, and AWS IAM Policies/Roles using attribute-based access controls

  * Knowledge of automated end-to-end and unit tests and testing platforms

  * Experience with implementing Observability solutions with platforms such a NewRelic/Dynatrace to implement JVM metrics tracking and python application tracking for microservice applications

  * Experience implementing complex pipelines and solving challenging problems in Github Actions Pipelines, Github Runner provisioning, execution, configuration and upgrade

  * Experience with implementing, managing and streamlining a release process with focus on code quality and code coverage

  * Strong verbal and nonverbal communication skills

  * Strong documentation and problem-solving skills Preferred Qualifications:

  * Databricks Experience preferred

  * Team leadership or product owner experience a plus

  * Experience with Git and DevOps

  * Experience with Kubernetes

Some experience with DevOps tools Terraform desire null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

DirectEmployers