- anew recruit
- $106,390.00 -159,250.00/year*
10 Bayside Terrace
We are hiring for Mid-Level and Senior Data Engineers. We are building world-class Big Data platform which will give us power to process streams of data and enable machine learning and advanced analytics capabilities. Everything cloud-based for scalability and speed to market. You ll handle large volumes of data and integrate our platform with a range of internal and external systems. If you re anything like us you ll be interested in new tech and how it can be applied to data management. Our internal customer base is growing all the time, and we re establishing ourselves as a true enterprise team using the latest technologies to make sure all customers get the best possible service. You ll join an agile team working alongside business, testers, architects and project managers. Focusing mainly on the development of complex logic integrations you ll pay equal attention to the quality of documentation, code, and business logic and non-functional. NFRs are a priority, so aspects like maintainable code, supportability, restorability, monitoring and performance need to be integral to any delivery. If you join us as a Senior, you will be a mentor to a team, and will need to bring some previous experience of this. And what you ll do Highly experience in writing well designed, testable, efficient code which follows good coding standards You re an expert in development and data quality You re a strong developer, and you have expertise in SQL to handle large data sets and complex data transformations You have experience with Python It s essential that you ve got experience of the full SDLC in an equivalent environment. You have worked in small focused scrum teams delivering events driven integrations across multiple teams. You're experienced in working within an integration environment with testers to ensure end to end performance and resilience SLA s can be achieved. Agile mindset and practice in software development process e.g. Scrum, Kanban, TDD, BDD Experience with Big data platforms Apache Spark Hadoop and Scala is a plus Experience with cloud solutions for Big Data (Snowflake, GCP BigQuery, AWS Redshift) Experience with data pipelines (e.g. Airflow) and streaming processing (Kafka, Kinesis, Spark Streaming, Flink) is a plus Experience with supporting Data Scientist (Machine Learning) is a plus You have experience mentoring other engineers
Associated topics: data administrator, data center, data integration, data management, data quality, data warehouse, erp, hbase, mongo database administrator, sybase
* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.
Loading some great jobs for you...