PySpark Engineer

Empresa confidencial

🎯 senior
We are looking for an experienced PySpark Engineer with 5+ years of experience to build and optimize large-scale distributed processing platforms. Key Skills: - PySpark & Python - Apache Spark & Distributed Systems - Spark Internals & Performance Optimization - Delta Lake, Parquet & Trino - Airflow & MinIO - Kubernetes & Containerized Environments - Linux, Git & Azure ADO - VS Code & GitHub Copilot If you have strong hands-on experience with Spark at enterprise scale and enjoy solving complex distributed processing challenges, we’d love to hear from you! Interested candidates can share their profiles at: manisha@oxconsultancy.com

Requisitos

  • 5+ years of experience
  • PySpark & Python
  • Apache Spark & Distributed Systems
  • Spark Internals & Performance Optimization
  • Delta Lake, Parquet & Trino
  • Airflow & MinIO
  • Kubernetes & Containerized Environments
  • Linux, Git & Azure ADO
  • VS Code & GitHub Copilot