Role: Java Spark Developer
Job ID: 5803
Location: Mississauga, ON (local candidates preferred – Greater Toronto Area)
Job Type: Full-time
Salary: $125K + benefits
Work Authorization: You must be eligible to work in Canada without sponsorship.
Positions Available: 4
Required Experience: 10 years
Job Description:
We are looking for a talented and experienced Java Spark Developer to join our dynamic team. As a Java Spark Developer, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable applications using Java and Apache Spark. You will work on data-intensive projects, leveraging the power of Spark for large-scale data processing and analytics.
Responsibilities:
- Design, develop, and maintain Java applications leveraging Apache Spark for distributed data processing and analytics.
- Collaborate with data engineers and data scientists to implement data pipelines, ETL processes, and machine learning workflows using Spark.
- Optimize and tune Spark jobs to ensure efficient utilization of computing resources and high throughput for data processing tasks.
- Integrate Java applications with Spark clusters, leveraging Spark’s APIs and libraries for data manipulation, transformation, and analysis.
- Develop and deploy real-time and batch processing applications using Spark Streaming and Spark SQL for data ingestion and analysis.
- Implement data caching, partitioning, and parallel processing techniques to optimize Spark job performance and resource utilization.
- Work with cloud-based platforms and big data technologies to deploy and manage Spark-based applications in distributed environments.
- Collaborate with cross-functional teams to understand business requirements, data models, and analytics use cases, and implement relevant solutions using Spark.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proven experience as a Java Developer with hands-on experience in Apache Spark for data processing and analytics.
- Strong proficiency in Java programming language with a focus on scalable and distributed systems.
- Experience with Apache Spark, Spark Streaming, Spark SQL, and related Spark ecosystem tools and libraries.
- Knowledge of big data technologies such as Hadoop, HDFS, and distributed computing frameworks for large-scale data processing.
- Familiarity with cloud platforms such as AWS, Azure, or GCP for deploying and managing Spark applications.
- Strong understanding of data structures, algorithms, and database technologies for data manipulation and analytics.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
- Experience with Agile development methodologies and tools (e.g., JIRA, Git) is preferred.
- Certification in Apache Spark or related big data technologies is advantageous.
If you are passionate about big data, distributed computing, and Java development, and you possess the required skills and experience, we would love to hear from you. Join our innovative team and contribute to the development of cutting-edge data processing and analytics solutions using Java and Apache Spark.
Industry: Information Technology
Job Category: Software Development, Big Data Analytics