Bigdata Engineer

Azure Data Engineer
  • Join one of Australia's fastest growing global organizations
  • fixed-term contract for 6 months and then turned to Permanent
  • Flexible working arrangements with hybrid work model-Across Australia
Job Summary for Seek:
Client seeks for a dedicated Data Engineer with Azure and spark experience to join a dynamic team in a high growth- Hybrid Working arrangements.

About the Company:
One of the fastest growing global organizations has an opportunity for a Azure Data Engineer
About the role
Looking for a Azure Data Engineer who will be responsible for developing and maintaining the data and standards for various Data Integration in Azure. In addition, develop and maintain the documentation of the data and can write the SQL queries and can able to script Spark or familiar with Scala and Python

About the Responsibilities:
  • Development of data pipelines per business requirements and within the standards of the enterprise data platform-Azure cloud platform.
  • Write a query by using SQL and able to script Scala to build innovative datasets that drive enterprise-wide analytical and reporting capabilities
  • Provide support for Data Platform operation and optimisation ensuring data is always processed and available on time
  • Identifying new opportunities for data acquisition to fill gaps and enhance existing datasets drive higher levels of performance
  • Understand data requirements from key stakeholders and develop solutions to achieve business outcomes
  • Take ownership of the end-to-end process from requirements gathering to implementation
Skills and experience:
  • 4+ years as a Data Engineer
  • Experience working with the Azure cloud platform, ideally Data Factory or Data Bricks with Azure Storage account / ADLS
  • Extensive experience with SQL
  • Experience working with Spark (Python or SCALA)
  • A sense of ownership, excellent communication, and team player
  • Good to have – Azure (in general), ETL / MSBI, Power BI, Hadoop ecosystem
Sydney (Waverton)
I.T. & T
Priyanka Saha