Data Engineer

Summary about this job

Detail information about job Data Engineer. Terms and conditions vacancy

• Passionate and knowledgeable team
• Career growth and development
• Fantastic reward, recognition and challenge

As a Data Integration Engineer you'll work collaboratively to integrate new data sources into the production pipeline and our products; automate and streamline our operational activities and processes and act as third level escalation to operations teams, ensuring timely delivery of data to quality. This exciting role sits within our Targeting team, part of Experian ANZs Data Quality and Targeting business unit.

 

About you

 

You will demonstrate 5 key attributes: Executive presence, intellect, drive, strong technical capabilities as well as a strong cultural fit to Experian.

 

About the role

 

Main Duties:

• Carry out routine processes in SQL for data processes, including data ingestion, cleaning, deduplication, matching, transformations and extraction

• Contribute to QA and Documentation of data processes

• Contribute to the design and implementation of new data processes, including:

o integration with external APIs

o automation workflows

o integrated data pipelines consisting of different technologies including SQL, Python and proprietary Experian products

• Communicate to internal stakeholders on the volume, quality and limitations of data assets

• Contribute to the development of new data assets

• Contribute to system, process and product innovation

Deployment

• Ensure all proposed changes to the production pipeline are effectively tested and peer reviewed prior to deployment.

• Work closely with the Technical Development and Analytics & Client Services team to ensure changes to the production data are checked and approved prior to deployment.

• Ensure change and release management processes are adhered to when making changes to the production environment.

• Verify the functionality of components and services and ensure deployment meets client's expectations.

• Document and complete knowledge transfer to the operations team.

 

Data Processing

• Ensure systems are in place to effectively track and alert when unexpected changes in data or systems availability occurs. 

• Act as a point of escalation for the Technical Development and the Analytics & Client Services teams when interruptions to data processing occur. 

• Troubleshoot and resolve escalated issues in collaboration with the Technical Development and the Analytics & Client Services teams, escalating to technical leads or strategic partner contacts as appropriate.

• Ensure there is appropriate communications to stakeholders in the event of processing exceptions.

 

Continuous improvement

• Identify gaps in processing systems and methodologies, working to improve stability and performance.

• Continuously improve our automation capabilities, reducing operational overhead and risk.

• Adapt the processing pipeline to meet changing business needs.

• Evaluate existing processing systems and methodologies and provide recommendations for improving functionality and processing efficiencies.

 

Documentation:

• Maintain all documentation required to support the Technical Development and the Analytics & Client Services teams

• Assist in the development of user guides and training documentation for supporting roles.

• Drive knowledge sharing and cross skilling between Technical Development and the Analytics & Client Services team members.

 

Knowledge and Experience

 

Technical - Essential

• Proficiency in SQL; prior experience with Microsoft SQL is advantageous, experience in other databases will also be considered favourably 

• Proficiency in API integrations; knowledge and understanding of how to work with REST APIs, and ability to develop solutions that interact with APIs on a large scale. Prior experience in working with APIs in Python is advantageous, experience in other scripting languages will also be considered favourably

• Knowledge and understanding of a variety of data formats and data structures, including the appropriate use of structured and unstructured data for applications in databases, software design, data-in-transit and file storage.

 

Technical – Good to have

• Software engineering best practice, software development lifecycle

• IT Operations best practice, such as the ITSM framework for incident and change management 

• Experience in relevant industries including digital advertising, data analytics, online retail, telecommunications, financial services

• Experience in AWS / cloud platforms

• Experience working with spatial data

• Experience in full-stack development, open source development

• Experience in DevOps, CI/CD, SysOps; advanced knowledge of computer hardware, operating systems, database and networking technologies

• Experience in designing/developing secure systems

 

Business

• Strong troubleshooting and problem solving skills.

• Solutions-focused, customer-centric personality and a love of innovation. 

• A passion for data and the use of technology to solve complex problems.

• Demonstrated ability to analyse and interpret complex problems or processes, identify and understand requirements, and develop alternate solutions.

• High level of written and verbal communication skills.

• Ensure adherence to implemented processes.

• A strong focus on business outcomes.

 

People skills

• Comfortable with collaboration, open communication and reaching across functional borders.

• Ability to maintain security and confidentiality over sensitive information.

• Able to work proactively, with team members, vendors and other staff to achieve goals.

• Team player with the ability to work autonomously.

• Able to engage people on all levels.

 

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering or other related field and/or equivalent work experience.

 

Why Experian?

At Experian we take pride in our people. We employ over 17,000 people in 40 countries.  In a faster, more complex world, our data and analytics help people and organisations protect, manage and make the most of their data.

 

Bringing data to life requires creativity, passion, flexibility and expertise. We want you to share in our success. That's why we offer rewards that recognise great performance. Working in a culture of collaboration, achievement and respect we will give you the support and encouragement you need to develop your skills and talents and progress your career. 

 

Everyday our people bring enthusiasm, innovation and inspiration to work and if this sound like you then connect with us at Experian. 

 

Our diverse workforce is part of the reason for our success. We want everyone to succeed, irrespective of their gender, ethnicity, sexuality, physical ability or age. We welcome applications from Torres Strait and Aboriginal people and our progressive policies, such as flexible working hours, ensure that our employees can flourish no matter what their individual circumstance.