Big Data Developer

Summary about this job

Detail information about job Big Data Developer. Terms and conditions vacancy

• For one of our household brand name Banking & Finance client
• Big Data developer for Data & Analytics Powerhouse
• Must have Hadoop background and ideally Teradata as well

Responsibilities:

• Translate business needs to technical specifications. Design, build, maintain and deploy BI solutions 
• Understand our customers' core business objectives and build end-to-end data centric solutions to address them
• Contribute to thought leadership enabling analytics teams to deliver world class data centric solutions and analytics by championing sustainable and re-useable data products
• Participate in the full lifecycle of agile projects (ideation through implementation)
• Design and build group data products by integrating diverse data from hundreds of internal and external sources
• Help to promote good coding standard and practices to ensure high quality and minimum risks
• Support the design and construction of large scale automated machine learning and data mining
• Conduct unit testing and expertise in CI/CD practices (highly desirable).
• Evaluate and improve existing BI system, Collaborate with teams to integrate systems
• Develop jobs and flows ensuring that all systems and procedures adhere to organizational best practices
• Performances tune the workflows on database & big data platform as part of the development process.
• Work closely with operation team on failures and triage issues and support them through to the resolutions (Dev-ops model).
• Collaborate with technical business analyst, to understand business requirements, data, and optimize ETL performance.
• Closely working with project manager and technical leads to provide regular status reporting and support them to identify blockers for quick resolution.

Required Skill

• Hadoop and Spark for distributed data storage and processing
• Teradata, Hbase and Cassandra to support OLAP and OLTP requirements
• Scala and Java for our back-end applications and data integration tools
• Proven expertise in large scale BI platforms, In-depth knowledge of at least one of the industry leading BI tools  and familiar with standard data warehouse practises and development standards ( A Must )
• In-depth knowledge of working with SQL, Analytical and problem-solving aptitude
• Peer Review and Participate in activities that ensure the successful use of these systems including: developing analysis and design documentation, test scripts etc.
• Provide required feedback and analysis to the technical lead/design team
• Support, monitor and perform required data analysis based on the ETL failure and provide solution/fix for those

Successful candidate for this role will have most (if not all) of the below characteristics:

• Worked in AGILE environment previously and familiarity with dev-ops model
• Highly motivated and fast learner of new skills & technologies
• Good communication skills both verbally and written
• Desire to work in fast pace environment and willingness to contribute to a high-performing and motivated workgroup
• Interest in the development of others - coaching, teaching and openly share knowledge to expand skills and capabilities of other team members.
• Experience in Banking background is added benefit but not must have.

You will be working in one of the best DWH team, be learning from some of the best data warehousing thought leaders in the current Australian market and will be working alongside with a handpicked team of highly motivated and capable individuals.

Contact directly on [email protected]

MUST HAVE WORK RIGHTS to AUSTRALIA

==== No agent please ====