Sr. Data Engineer (Platform)
As a Data Platform Engineer in Gogolook, you will play a critical role in designing, building, and maintaining our data platform infrastructure. You will collaborate with cross-functional teams to ensure data availability, reliability, and scalability for our organization's growing data needs. If you are passionate and looking to implement DataOps practices fostering collaboration and automation in data workflows, we invite you to join our team as a Data Platform Engineer. Responsibilities - Design and construct comprehensive ETL pipelines for high-performance, large-volume applications. - Build and enhance the data architecture to support business intelligence systems and product applications. - Implement data governance and security measures to ensure data privacy and compliance with relevant regulations. - Create automation processing to reduce development time and increase data reliability. Minimum qualifications - Minimum of 3 years of hands-on software development experience in languages such as Python, Scala, Java, Golang, etc. - With expertise in optimizing data flow and processing efficiency and experience handling data throughput of up to 1 million records per hour. - Hands-on experience with cloud platforms like AWS, GCP or Azure. - Proficiency in developing robust data pipelines, including data collection and ETL(Extract, Transform, Load) processes. - Experience designing and implementing various components of a data platform, including data ingestion, storage, data warehousing, data orchestration. - Experience deploying infrastructure as code using CloudFormation or Terraform in AWS, GCP or Azure. - Experience in continuous integration and continuous deployment(CI/CD) processes.公司地址:
台北市大安區敦化南路二段319號其他:
Preferred qualifications - Experience in Docker, Kubernetes or Helm Charts. - Experience in machine learning platforms, like KubeFlow, MLflow or Vertex AI. - Has experience with API design and implementation. - Has experience using streaming tools like Kafka, AWS Kinesis, Spark streaming or Flink. 取得AWS認證者，可獲得優先面試機會(2022AWSUTC)-2024-09-17