Job Title: Scala Developer
Job ID: 6416
Job Location: Remote, BC
Job Type: Full-time
Pay Rate: Competitive
Work Authorization: Must be eligible to work in Canada without sponsorship.
Our client is seeking an experienced Scala Developer with a strong background in Scala, Spark, Hive, and Hadoop to join our dynamic team of IT professionals. As a Scala Developer, you will be responsible for designing, analyzing, and organizing raw data, building robust data systems and pipelines, and conducting complex data analysis. Your role will involve integrating raw information from various sources, enhancing data quality and reliability, and identifying opportunities for data acquisition. You will develop analytical tools and programs, collaborating closely with data scientists and architects on multiple projects to drive organizational goals.
Responsibilities:
- Design, Analyze, and Organize Raw Data: Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
- Build Data Systems and Pipelines: Architect and implement data pipelines and systems to support large-scale data processing.
- Conduct Complex Data Analysis: Perform complex data analysis and generate reports to provide actionable insights.
- Combine Raw Information: Integrate data from various sources to create unified data sets.
- Enhance Data Quality and Reliability: Identify and implement processes to improve data quality and reliability.
- Identify Data Acquisition Opportunities: Explore and evaluate opportunities for acquiring new data sources.
- Develop Analytical Tools and Programs: Create and maintain analytical tools and programs to support data-driven decision-making.
- Collaborate on Projects: Work closely with data scientists, architects, and other stakeholders on various projects to achieve organizational goals.
Required Skills:
- Unix and Shell Scripting: Proficient in Unix and shell scripting for automation and task management.
- CI/CD Pipeline Exposure: Familiarity with Git and Jenkins CI/CD pipeline for version control and continuous integration/continuous deployment.
- Data Engineering Experience: Previous experience as a data engineer or in a similar role, demonstrating expertise in managing large-scale data environments.
- Technical Expertise: Hands-on experience with Spark and Scala, Hive, and Hadoop.
- Programming Skills: Proficient in programming languages, especially Scala, with a basic understanding of Java.
- SQL and HiveQL: Strong skills in SQL and Hive query language for data manipulation and querying.
- Cloud Experience (Nice to Have): Experience with any cloud platform is an added advantage.
If you are passionate about data engineering and eager to work on challenging projects with a talented team, we encourage you to apply for this exciting opportunity.
Job Industry: Information Technology
Job Category: Data Engineering