... architect, develop, and maintain scalable and efficient data processing pipelines using PySpark and other ... as Apache Spark Familiarity with working in Azure - experience with Data Factory is strongly desired ...