Big Data Developer - Python - Hadoop - Spark - Scala

All vacancies of Australia • Information & Communication Technology • Big Data Developer - Python - Hadoop - Spark - Scala

Exciting permanent opportunities to work with leading Big Data Analytics team. Hadoop - Spark - Python - AWS

Summary about this job

Developers/Programmers

Company: CITI Recruitment

Location: Sydney

Work type: Full Time

Salary: Permanent

Phone: +61-3-9097-4844

Fax: +61-7-2105-2013

E-mail: n\a

Site: n\a

Detail information about job Big Data Developer - Python - Hadoop - Spark - Scala. Terms and conditions vacancy

You will have proven experience in Big Data application development skills as well as multiple design techniques.

Working proficiency in Big Data development toolset to design, develop, test, deploy, maintain and improve software.

Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test Driven Development, Cloud Development, application resiliency and security.

Job Description:

Create software components (using Python, SQL and Big Data tech i.e. Hadoop - Spark)
Integrate data from a variety of data sources utilising on-prem or cloud-based data structures (AWS)
Determine new and existing data sources
Develop, implement and optimize streaming, data lake, and analytics big data solutions
Create and execute testing strategies including unit, integration, and full end-to-end tests of data pipelines
Utilise ETL processes to build data repositories; integrate data into Hadoop data lake
Work directly with data scientists as well as business teams to meet both functional and technical requirements
Work with dveops teams to deploy and integrate software solutions

Required Skills:

5+ years’ experience developing software solutions in Python
Experience developing in Java/ Scala, or other functional languages - Clojure - Haskell
Strong computer science skills (data structures, algorithms)
Strong experience with data modelling and modern databases (SQL, Oracle, PL/SQL)
Experience with the Hadoop - Spark technology stack is a strong plus

Please understand due to number of applications only suitable candidates will be contacted.

More similar vacancies

Responds for Big Data Developer - Python - Hadoop - Spark - Scala on FaceBook

Read all comments for Big Data Developer - Python - Hadoop - Spark - Scala. Leave a respond Big Data Developer - Python - Hadoop - Spark - Scala in social networks. Big Data Developer - Python - Hadoop - Spark - Scala on Facebook, LinkedIn and Google+